-- Logs begin at Thu 2021-11-11 16:12:42 UTC, end at Thu 2021-11-11 17:34:29 UTC. -- Nov 11 17:05:12.931809 dv-cinder-694140-2-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 11 17:05:15.701190 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.common.config [-] Logging enabled! Nov 11 17:05:15.701833 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev157 Nov 11 17:05:15.701966 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102214) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 11 17:05:15.705091 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.common.config [-] Logging enabled! Nov 11 17:05:15.705346 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev157 Nov 11 17:05:15.705696 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102214) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 11 17:05:15.706650 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 17:05:15.706886 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 17:05:15.707249 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 17:05:15.707497 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 17:05:15.707724 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 17:05:15.708073 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.708534 dv-cinder-694140-2-iscsi neutron-server[102214]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 11 17:05:15.708864 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.709141 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.709434 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.709728 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.710019 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.710302 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.710616 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.710919 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.711206 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.711485 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.711766 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.712055 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.712334 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] config_source = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.712615 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.712899 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.713178 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] debug = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.713456 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.713891 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.714290 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.714599 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.714890 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.715165 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.715437 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.715711 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.715992 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.716319 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] host = dv-cinder-694140-2-iscsi {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.716615 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.716881 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.717165 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.717450 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.717723 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.717999 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.718282 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.718562 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] log_dir = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.718851 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] log_file = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.719127 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.719413 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.719698 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.720002 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.720208 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.720429 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.720725 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.721007 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.721835 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.722112 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.722389 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.722699 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.722974 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.723242 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.723523 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.723807 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.724092 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.724370 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.724642 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.724909 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.725178 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.725458 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.725729 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.726000 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.726271 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.726561 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.726843 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.727114 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.727410 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.727691 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.727999 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.728252 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.728521 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.728799 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.729085 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.729333 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] use_journal = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.729599 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] use_json = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.729867 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.730132 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.730407 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.730698 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.730967 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.731236 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.731500 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.731780 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:15.732069 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.732361 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.732659 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.732938 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.733235 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.733774 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.734067 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.734347 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.734657 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.734944 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.735229 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.735505 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.735788 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.736063 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.736352 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.736661 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.737554 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.737846 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.738119 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.738393 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.738693 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.738973 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.739259 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.739534 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.739820 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.740125 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.740387 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.740671 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.740961 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.741249 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.741520 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.741798 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.742086 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.742360 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.742664 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.742942 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.743229 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.743503 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.743771 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.744048 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.744326 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.744596 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.744863 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.745134 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.745419 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.745690 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.745955 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.746219 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.746490 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.746783 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.747064 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.747332 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.747598 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.747863 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.748135 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.748404 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.748671 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.748942 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.749209 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.749482 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.749750 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.750016 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.750286 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.750574 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.750845 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.751112 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.751378 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.751648 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.751913 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.752180 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.752488 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.752759 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.753026 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.753308 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.753603 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.753875 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.754149 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.754429 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.754731 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.755006 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.755277 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.755552 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.755827 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.756095 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.756381 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.756659 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.756942 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.757220 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.757492 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.757808 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.758082 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.758360 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.758655 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.758933 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.759213 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.759493 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.759782 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.760071 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.760361 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.760652 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.760938 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.761215 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.761518 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.761793 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:15.762008 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 17:05:15.762247 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=102214) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 11 17:05:16.199085 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=102214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 17:05:16.199382 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=102214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 17:05:16.199662 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=102214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 17:05:16.199995 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 11 17:05:16.528128 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.528317 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.528595 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.529798 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.530070 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.530335 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.565679 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.565958 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.566224 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.582135 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.582417 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.582712 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.614085 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.614381 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.614654 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.651158 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.651431 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.651697 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.898011 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.898732 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.898732 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.898914 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:16.899524 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.045315 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.045631 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.045915 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.046188 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.046457 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.046793 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.047054 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.047312 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.047567 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.047854 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.048113 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.048376 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.048630 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.048881 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.049136 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.049447 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.049706 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.049974 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.050244 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.050505 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.050802 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.051061 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.051344 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.051729 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.051978 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.052223 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.052721 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=102214) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 17:05:17.053003 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=102214) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 17:05:17.053248 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=102214) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 17:05:17.054459 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=102214) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 17:05:17.054780 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=102214) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 17:05:17.055033 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=102214) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 17:05:17.055411 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 11 17:05:17.058902 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 11 17:05:17.062962 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 11 17:05:17.067408 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(500, 549)])]) Nov 11 17:05:17.069058 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 11 17:05:17.069514 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 11 17:05:17.069850 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 11 17:05:17.070238 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 11 17:05:17.074288 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 11 17:05:17.074527 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 11 17:05:17.074913 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 11 17:05:17.080298 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 11 17:05:17.104886 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 11 17:05:17.105355 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.105660 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=102214) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} Nov 11 17:05:17.106023 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.107481 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=102214) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 11 17:05:17.107775 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 11 17:05:17.108024 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 11 17:05:17.114514 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.115236 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:17.188342 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 11 17:05:17.188582 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 11 17:05:17.188817 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 11 17:05:17.189207 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 11 17:05:17.214002 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_db.sqlalchemy.engines [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 17:05:17.912617 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Initializing driver for type 'gre' Nov 11 17:05:17.913294 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] gre ID ranges: [(1, 1000)] Nov 11 17:05:18.152212 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Initializing driver for type 'local' Nov 11 17:05:18.152537 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Initializing driver for type 'vlan' Nov 11 17:05:18.266459 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] VlanTypeDriver initialization complete Nov 11 17:05:18.266757 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Initializing driver for type 'vxlan' Nov 11 17:05:18.267299 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] vxlan ID ranges: [(1, 1000)] Nov 11 17:05:18.535721 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Initializing extension driver 'port_security' Nov 11 17:05:18.535980 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.extensions.port_security [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] PortSecurityExtensionDriver initialization complete Nov 11 17:05:18.536309 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Initializing mechanism driver 'openvswitch' Nov 11 17:05:18.536630 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Initializing mechanism driver 'hyperv' Nov 11 17:05:18.543462 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.plugins.ml2.plugin [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=102214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:05:18.544298 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > port after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.544671 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > port after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.545024 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > port after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.545597 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=102214) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 11 17:05:18.546031 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > subnet after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.546383 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > subnet after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.546762 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > subnet after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.547157 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=102214) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 11 17:05:18.547558 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > network after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.547903 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > network after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.548239 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > network after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.548628 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=102214) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 11 17:05:18.549030 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > security_group after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.549376 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > security_group after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.549714 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > security_group after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.550102 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=102214) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 11 17:05:18.550508 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.550875 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.551211 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.551670 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=102214) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 11 17:05:18.552073 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > address_group after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.552408 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > address_group after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.552741 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > address_group after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.553130 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=102214) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 11 17:05:18.553503 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] ML2 OVO RPC backend initialized. {{(pid=102214) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 11 17:05:18.554238 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router_interface after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.554622 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.555033 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > network before_response 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.555377 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > networks before_response 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.555718 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > port before_response 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.556054 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > ports before_response 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.556390 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > subnet before_response 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.556808 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > subnets before_response 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.557148 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > network after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.557481 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > network after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.557839 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > network after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.558152 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > port after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.558482 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > port after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.558837 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > port after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.559170 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > subnet after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.559551 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > subnet after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.559839 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > subnet after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.560414 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.plugin [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Modular L2 Plugin initialization complete Nov 11 17:05:18.560747 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading services supported by the core plugin {{(pid=102214) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 11 17:05:18.561064 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.plugins.ml2.managers [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Got port-security extension from driver 'port_security' Nov 11 17:05:18.561523 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.extensions.vlantransparent [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Disabled vlantransparent extension. Nov 11 17:05:18.562002 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=102214) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 11 17:05:18.562311 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading Plugin: router Nov 11 17:05:18.601787 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router_interface before_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.602180 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router after_create 55549900 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.602560 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router before_create 55549900 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.603032 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.603406 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.603759 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router after_delete 55549900 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.604113 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > floatingip after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.604584 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > floatingip after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.604943 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router after_create 55549900 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.605287 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router after_update 55549900 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.605638 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router after_update 55549900 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.605978 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.606333 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router after_update 55549900 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.606765 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router precommit_update 55549900 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.607128 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: port after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.607462 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: port after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.607794 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: subnet after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.608127 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.608469 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > port precommit_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.609064 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router precommit_create 55549900 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.609398 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: port before_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.609733 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router precommit_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.610153 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router after_update 55549900 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.610492 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router precommit_delete 55549900 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.610891 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router precommit_create 55549900 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.623334 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router_interface after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.623334 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router precommit_update 55549900 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.623334 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > agent after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.623334 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > agent after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.623653 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > network after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.623653 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Tracking information for resource: router configured {{(pid=102214) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 17:05:18.623653 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Tracking information for resource: floatingip configured {{(pid=102214) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 17:05:18.624357 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.db.l3_agentschedulers_db [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 11 17:05:18.624935 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: port after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.625290 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: port after_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.625636 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: port after_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.625981 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: port after_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.627167 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router before_create 55550100 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.627532 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router precommit_delete 55550100 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.628402 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router precommit_create 55550100 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.628759 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > router precommit_update 55550100 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.633912 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.services.provider_configuration [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Service providers = [] {{(pid=102214) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 11 17:05:18.634275 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.db.servicetype_db [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=102214) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 11 17:05:18.637297 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.services.service_base [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=102214) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 11 17:05:18.637640 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.services.service_base [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=102214) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 11 17:05:18.637981 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.services.service_base [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=102214) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 11 17:05:18.638895 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.services.service_base [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=102214) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 11 17:05:18.639264 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.services.service_base [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 11 17:05:18.639636 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=102214) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 11 17:05:18.639948 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 11 17:05:18.656844 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=102214) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 11 17:05:18.657174 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading Plugin: auto_allocate Nov 11 17:05:18.663063 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: network precommit_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.663433 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: network precommit_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.663953 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=102214) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 11 17:05:18.664268 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading Plugin: tag Nov 11 17:05:18.671329 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=102214) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 11 17:05:18.671658 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading Plugin: timestamp Nov 11 17:05:18.675518 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=102214) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 11 17:05:18.675842 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading Plugin: network_ip_availability Nov 11 17:05:18.681393 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.681759 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.682110 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.682856 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=102214) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 11 17:05:18.683172 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading Plugin: flavors Nov 11 17:05:18.688233 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=102214) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 11 17:05:18.688562 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading Plugin: revisions Nov 11 17:05:18.693392 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=102214) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 11 17:05:18.693779 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_concurrency.lockutils [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 2.494s {{(pid=102214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 17:05:18.694511 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=102214) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 11 17:05:18.694865 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Initializing extension manager. Nov 11 17:05:18.695381 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: __init__.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.695716 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: __pycache__ {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.696042 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.696366 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: address_group.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.697127 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.697685 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: address-group Nov 11 17:05:18.698108 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: address_scope.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.698853 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.699362 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: address-scope Nov 11 17:05:18.699679 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: admin_state_down_before_update.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.700600 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.701107 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: router-admin-state-down-before-update Nov 11 17:05:18.701427 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: agent.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.702117 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.702647 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: agent Nov 11 17:05:18.702968 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: agent_resources_synced.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.703923 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.704428 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: agent-resources-synced Nov 11 17:05:18.704745 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: allowedaddresspairs.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.707098 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.707617 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: allowed-address-pairs Nov 11 17:05:18.707942 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: auto_allocated_topology.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.709021 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.709538 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: auto-allocated-topology Nov 11 17:05:18.709863 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: availability_zone.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.710561 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.711082 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: availability_zone Nov 11 17:05:18.711400 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: availability_zone_filter.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.712302 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.712807 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: availability_zone_filter Nov 11 17:05:18.713130 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: data_plane_status.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.714032 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.714535 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension data-plane-status not supported by any of loaded plugins Nov 11 17:05:18.714873 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: default_subnetpools.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.715778 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.716280 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: default-subnetpools Nov 11 17:05:18.716598 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: dhcpagentscheduler.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.717402 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.717898 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: dhcp_agent_scheduler Nov 11 17:05:18.718217 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: dns.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.719190 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.719687 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension dns-integration not supported by any of loaded plugins Nov 11 17:05:18.720005 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: dns_domain_ports.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.720909 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.721427 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 11 17:05:18.721745 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.722677 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.723183 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 11 17:05:18.723496 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: dvr.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.724160 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.724660 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: dvr Nov 11 17:05:18.724976 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: ecmp_routes.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.725881 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.726380 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension ecmp_routes not supported by any of loaded plugins Nov 11 17:05:18.726728 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: empty_string_filtering.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.727635 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.728149 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: empty-string-filtering Nov 11 17:05:18.728470 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.729378 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.729880 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 11 17:05:18.730199 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.731117 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.731621 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 11 17:05:18.731937 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: external_net.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.732853 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.733354 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: external-net Nov 11 17:05:18.733671 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: extra_dhcp_opt.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.734864 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.735370 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: extra_dhcp_opt Nov 11 17:05:18.735684 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: extraroute.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.736581 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.737114 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: extraroute Nov 11 17:05:18.737431 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: extraroute_atomic.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.738444 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.738981 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: extraroute-atomic Nov 11 17:05:18.739300 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: filter_validation.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.740166 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.740672 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: filter-validation Nov 11 17:05:18.740991 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: fip_pf_description.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.741897 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.742402 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 11 17:05:18.742751 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: fip_port_details.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.743675 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.744186 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: fip-port-details Nov 11 17:05:18.744503 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: flavors.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.745736 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.746253 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: flavors Nov 11 17:05:18.746597 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.748282 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.748797 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 11 17:05:18.749120 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: floatingip_pools.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.749817 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.750322 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: floatingip-pools Nov 11 17:05:18.750703 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: ip_allocation.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.751606 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.752107 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension ip_allocation not supported by any of loaded plugins Nov 11 17:05:18.752427 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.753859 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.754363 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: ip-substring-filtering Nov 11 17:05:18.754720 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: l2_adjacency.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.755641 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.756140 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension l2_adjacency not supported by any of loaded plugins Nov 11 17:05:18.756528 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: l3.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.757488 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.757997 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: router Nov 11 17:05:18.758316 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: l3_conntrack_helper.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.760592 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.761115 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 11 17:05:18.761445 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.762369 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.762918 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: ext-gw-mode Nov 11 17:05:18.763248 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.764171 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.764678 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: l3-ha Nov 11 17:05:18.765002 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: l3_flavors.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.765914 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.766418 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: l3-flavors Nov 11 17:05:18.766873 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.767779 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.768846 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: l3-port-ip-change-not-allowed Nov 11 17:05:18.771224 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: l3agentscheduler.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.772267 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.772779 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: l3_agent_scheduler Nov 11 17:05:18.773103 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: logging.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.774634 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.775164 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension logging not supported by any of loaded plugins Nov 11 17:05:18.775488 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: metering.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.776230 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.776915 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: metering Nov 11 17:05:18.777241 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.778445 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.778993 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: metering_source_and_destination_fields Nov 11 17:05:18.779318 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: multiprovidernet.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.780238 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.780745 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: multi-provider Nov 11 17:05:18.781066 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: netmtu.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.781972 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.782474 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: net-mtu Nov 11 17:05:18.782819 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: netmtu_writable.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.783764 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.784289 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: net-mtu-writable Nov 11 17:05:18.784611 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: network_availability_zone.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.785280 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.785828 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: network_availability_zone Nov 11 17:05:18.786102 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: network_ip_availability.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.787229 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.787741 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: network-ip-availability Nov 11 17:05:18.788064 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: network_segment_range.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.788823 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.789322 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension network-segment-range not supported by any of loaded plugins Nov 11 17:05:18.789646 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: pagination.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.790640 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.790971 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: pagination Nov 11 17:05:18.791289 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: port_device_profile.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.801203 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.802658 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: port-device-profile Nov 11 17:05:18.803049 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.804079 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.804592 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: port-mac-address-regenerate Nov 11 17:05:18.804914 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.806246 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.807118 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: port-numa-affinity-policy Nov 11 17:05:18.807442 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: port_resource_request.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.808366 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.809595 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension port-resource-request not supported by any of loaded plugins Nov 11 17:05:18.809595 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: port_resource_request_groups.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.810163 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.811070 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 11 17:05:18.811610 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: portbindings.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.813028 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.813551 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: binding Nov 11 17:05:18.813873 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: portbindings_extended.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.815871 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.816381 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: binding-extended Nov 11 17:05:18.816735 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: portsecurity.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.817661 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.818170 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: port-security Nov 11 17:05:18.818490 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: project_id.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.819546 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.819873 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: project-id Nov 11 17:05:18.820193 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: providernet.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.821111 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.821625 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: provider Nov 11 17:05:18.821944 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: qos.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.825680 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.826202 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension qos not supported by any of loaded plugins Nov 11 17:05:18.826531 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.827802 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.828315 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 11 17:05:18.828645 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.829560 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.830072 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 11 17:05:18.830398 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: qos_default.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.831364 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.831868 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension qos-default not supported by any of loaded plugins Nov 11 17:05:18.832192 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: qos_fip.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.832853 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.833356 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension qos-fip not supported by any of loaded plugins Nov 11 17:05:18.833678 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: qos_gateway_ip.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.834626 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.835132 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 11 17:05:18.835452 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: qos_port_network_policy.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.836358 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.836867 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 11 17:05:18.837182 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.838211 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.838752 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 11 17:05:18.839073 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: qos_pps_rule.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.840257 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.840953 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension qos-pps not supported by any of loaded plugins Nov 11 17:05:18.841277 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: qos_rule_type_details.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.842187 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.842719 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 11 17:05:18.843039 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: qos_rules_alias.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.844096 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.844602 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 11 17:05:18.844919 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: quota_check_limit.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.845820 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.846326 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: quota-check-limit Nov 11 17:05:18.846707 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: quotasv2.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.847664 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.847988 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: quotas Nov 11 17:05:18.848383 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: quotasv2_detail.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.851551 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.851892 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: quota_details Nov 11 17:05:18.852218 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: rbac.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.853294 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.853823 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: rbac-policies Nov 11 17:05:18.854152 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: rbac_address_group.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.855119 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.855629 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: rbac-address-group Nov 11 17:05:18.855953 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: rbac_address_scope.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.856876 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.857388 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: rbac-address-scope Nov 11 17:05:18.857710 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: rbac_security_groups.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.858650 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.859411 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: rbac-security-groups Nov 11 17:05:18.859731 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: rbac_subnetpool.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.860640 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.861143 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: rbac-subnetpool Nov 11 17:05:18.861464 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: revisionifmatch.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.862932 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.863440 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: revision-if-match Nov 11 17:05:18.863764 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: revisions.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.864880 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.865388 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: standard-attr-revisions Nov 11 17:05:18.865709 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: router_availability_zone.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.866403 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.866942 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: router_availability_zone Nov 11 17:05:18.867262 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: routerservicetype.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.868282 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.868791 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension router-service-type not supported by any of loaded plugins Nov 11 17:05:18.869110 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.870031 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.870559 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: security-groups-normalized-cidr Nov 11 17:05:18.870877 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: security_groups_port_filtering.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.871875 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.872379 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: port-security-groups-filtering Nov 11 17:05:18.872698 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.873622 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.874454 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: security-groups-remote-address-group Nov 11 17:05:18.874454 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.875441 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.875943 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: security-groups-shared-filtering Nov 11 17:05:18.876268 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.876846 dv-cinder-694140-2-iscsi neutron-server[102214]: WARNING neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 11 17:05:18.877162 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: securitygroup.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.887753 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.888287 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: security-group Nov 11 17:05:18.888614 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: segment.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.889402 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.889909 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension segment not supported by any of loaded plugins Nov 11 17:05:18.890229 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.891198 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.891708 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 11 17:05:18.892096 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: servicetype.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.893128 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.893683 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: service-type Nov 11 17:05:18.894008 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: sorting.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.895007 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.895341 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: sorting Nov 11 17:05:18.895662 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: standard_attr_segment.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.896570 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.897082 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 11 17:05:18.897403 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: standardattrdescription.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.898046 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.898566 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: standard-attr-description Nov 11 17:05:18.898901 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: stateful_security_group.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.899844 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.900357 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: stateful-security-group Nov 11 17:05:18.900679 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: stdattrs_common.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.901246 dv-cinder-694140-2-iscsi neutron-server[102214]: WARNING neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 11 17:05:18.901564 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.902480 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.903015 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 11 17:05:18.903332 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: subnet_onboard.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.904413 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.904933 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: subnet_onboard Nov 11 17:05:18.905258 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.906187 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.906728 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 11 17:05:18.907051 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: subnet_service_types.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.907971 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.908479 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: subnet-service-types Nov 11 17:05:18.908802 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: subnetallocation.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.909913 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.910426 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: subnet_allocation Nov 11 17:05:18.910777 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.911440 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.911947 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: subnetpool-prefix-ops Nov 11 17:05:18.912267 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.913190 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.913709 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 11 17:05:18.914004 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: tagging.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.915131 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.915645 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: standard-attr-tag Nov 11 17:05:18.915970 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: timestamp.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.917166 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.917676 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loaded extension: standard-attr-timestamp Nov 11 17:05:18.918001 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: trunk.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.919043 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.919556 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension trunk not supported by any of loaded plugins Nov 11 17:05:18.919879 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: trunk_details.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.920789 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.921295 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension trunk-details not supported by any of loaded plugins Nov 11 17:05:18.921616 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: uplink_status_propagation.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.922559 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.923073 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 11 17:05:18.923396 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Loading extension file: vlantransparent.py {{(pid=102214) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 17:05:18.924065 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=102214) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 17:05:18.925090 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extension vlan-transparent not supported by any of loaded plugins Nov 11 17:05:18.927670 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of TrackedResource for resource:network Nov 11 17:05:18.928189 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of TrackedResource for resource:subnet Nov 11 17:05:18.928585 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of TrackedResource for resource:subnetpool Nov 11 17:05:18.928978 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of TrackedResource for resource:port Nov 11 17:05:18.930231 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.v2.resource_helper [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102214) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 17:05:18.930716 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.v2.resource_helper [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Service FLAVORS assigned prefix: {{(pid=102214) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 17:05:18.931330 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.v2.resource_helper [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102214) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 17:05:18.931757 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.v2.resource_helper [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102214) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 17:05:18.932085 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of TrackedResource for resource:router Nov 11 17:05:18.932514 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of TrackedResource for resource:floatingip Nov 11 17:05:18.933013 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.v2.resource_helper [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Service METERING assigned prefix: /metering {{(pid=102214) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 17:05:18.934450 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.934845 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.935188 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:05:18.936191 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of CountableResource for resource:rbac_policy Nov 11 17:05:18.936632 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of TrackedResource for resource:security_group Nov 11 17:05:18.937067 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 11 17:05:18.937654 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.v2.resource_helper [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Service CORE assigned prefix: {{(pid=102214) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 17:05:18.937979 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of TrackedResource for resource:subnetpool Nov 11 17:05:18.938321 dv-cinder-694140-2-iscsi neutron-server[102214]: WARNING neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] subnetpool is already registered Nov 11 17:05:18.938785 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.v2.resource_helper [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Service CORE assigned prefix: {{(pid=102214) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 17:05:18.939117 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of TrackedResource for resource:subnetpool Nov 11 17:05:18.939445 dv-cinder-694140-2-iscsi neutron-server[102214]: WARNING neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] subnetpool is already registered Nov 11 17:05:18.942381 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.v2.resource_helper [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102214) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 17:05:18.942832 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.v2.resource_helper [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Service FLAVORS assigned prefix: {{(pid=102214) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 17:05:18.943454 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.v2.resource_helper [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102214) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 17:05:18.943903 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.v2.resource_helper [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102214) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 17:05:18.944230 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of TrackedResource for resource:router Nov 11 17:05:18.944565 dv-cinder-694140-2-iscsi neutron-server[102214]: WARNING neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] router is already registered Nov 11 17:05:18.944970 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of TrackedResource for resource:floatingip Nov 11 17:05:18.945298 dv-cinder-694140-2-iscsi neutron-server[102214]: WARNING neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] floatingip is already registered Nov 11 17:05:18.945761 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.v2.resource_helper [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Service METERING assigned prefix: /metering {{(pid=102214) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 17:05:18.946462 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of CountableResource for resource:rbac_policy Nov 11 17:05:18.946810 dv-cinder-694140-2-iscsi neutron-server[102214]: WARNING neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] rbac_policy is already registered Nov 11 17:05:18.947226 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of TrackedResource for resource:security_group Nov 11 17:05:18.947563 dv-cinder-694140-2-iscsi neutron-server[102214]: WARNING neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] security_group is already registered Nov 11 17:05:18.947968 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 11 17:05:18.948311 dv-cinder-694140-2-iscsi neutron-server[102214]: WARNING neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] security_group_rule is already registered Nov 11 17:05:18.948790 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.v2.resource_helper [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Service CORE assigned prefix: {{(pid=102214) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 17:05:18.949112 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of TrackedResource for resource:subnetpool Nov 11 17:05:18.949438 dv-cinder-694140-2-iscsi neutron-server[102214]: WARNING neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] subnetpool is already registered Nov 11 17:05:18.949849 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.v2.resource_helper [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Service CORE assigned prefix: {{(pid=102214) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 17:05:18.950166 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Creating instance of TrackedResource for resource:subnetpool Nov 11 17:05:18.950491 dv-cinder-694140-2-iscsi neutron-server[102214]: WARNING neutron.quota.resource_registry [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] subnetpool is already registered Nov 11 17:05:18.952213 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: extensions {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.953675 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: address-groups {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.955186 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: address-scopes {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.956414 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: agents {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.957675 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: auto-allocated-topology {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.958941 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: availability_zones {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.960158 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: dhcp-networks {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.961564 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: dhcp-agents {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.963122 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: routers {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.965238 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: flavors {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.966489 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: service_profiles {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.967726 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: next_providers {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.969273 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: service_profiles {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.970738 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: floatingip-pools {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.972080 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: routers {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.974172 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: floatingips {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.975643 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: l3-routers {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.977023 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: l3-agents {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.978411 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: metering-labels {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.979692 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: metering-label-rules {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.981055 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: network-ip-availabilities {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.982309 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: bindings {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.984325 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: quotas {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.985969 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: quotas {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.988046 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: rbac-policies {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.989226 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: security-groups {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.990576 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: security-group-rules {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.991816 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: service-providers {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.993016 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: subnetpools {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.994413 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: subnetpools {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.995916 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: tags {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.997627 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: tags {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:18.999472 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: tags {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:19.001239 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: tags {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:19.003479 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: tags {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:19.005444 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: tags {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:19.007179 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: tags {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:19.009917 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: tags {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:19.011715 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: tags {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:19.013461 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron.api.extensions [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Extended resource: tags {{(pid=102214) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 17:05:19.019677 dv-cinder-694140-2-iscsi neutron-server[102214]: WARNING keystonemiddleware.auth_token [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 17:05:19.024128 dv-cinder-694140-2-iscsi neutron-server[102214]: WARNING keystonemiddleware.auth_token [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 17:05:19.033079 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_concurrency.lockutils [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Acquired lock "singleton_lock" {{(pid=102214) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 11 17:05:19.033550 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_concurrency.lockutils [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Releasing lock "singleton_lock" {{(pid=102214) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 11 17:05:19.034211 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO oslo_service.service [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Starting 2 workers Nov 11 17:05:19.039138 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Started child 102323 {{(pid=102214) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 11 17:05:19.043501 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Started child 102324 {{(pid=102214) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 11 17:05:19.044651 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:19.045338 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO neutron.service [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Neutron service started, listening on 0.0.0.0:9696 Nov 11 17:05:19.045620 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Publish callbacks [] for process, before_spawn {{(pid=102214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:19.046148 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [-] (102323) wsgi starting up on http://0.0.0.0:9696 Nov 11 17:05:19.048066 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO oslo_service.service [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Starting 1 workers Nov 11 17:05:19.048409 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:19.050323 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [-] (102324) wsgi starting up on http://0.0.0.0:9696 Nov 11 17:05:19.053892 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Started child 102325 {{(pid=102214) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 11 17:05:19.054422 dv-cinder-694140-2-iscsi neutron-server[102214]: INFO oslo_service.service [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Starting 1 workers Nov 11 17:05:19.057618 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.service [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] calling RpcWorker wait() {{(pid=102325) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 11 17:05:19.058186 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.service [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] returning from RpcWorker wait() {{(pid=102325) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 11 17:05:19.058926 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Started child 102326 {{(pid=102214) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 11 17:05:19.059605 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:19.059705 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG neutron_lib.callbacks.manager [None req-21ccebbc-e4e5-4199-9bf7-2164179cefc6 None None] Publish callbacks [] for process, after_spawn {{(pid=102214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:19.060138 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:05:19.061554 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102214) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 11 17:05:19.061762 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 17:05:19.061944 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 17:05:19.062159 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 17:05:19.062499 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 17:05:19.062704 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 17:05:19.063244 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.063516 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.063756 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:19.064226 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.064226 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.064372 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.064828 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.064921 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:05:19.065109 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.065904 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.066177 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.066425 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.066632 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.066798 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.067042 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.067287 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.067574 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.067821 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.068078 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.068349 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.068518 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.068762 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.069030 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.069265 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.069519 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] debug = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.069861 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.070338 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.070665 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.070911 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.071271 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.071414 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.071670 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.071935 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.072175 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.072387 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.072623 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.072888 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.073124 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.073332 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.073582 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.073790 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.074028 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.074246 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.074739 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] host = dv-cinder-694140-2-iscsi {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.074959 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.075190 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.075413 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.075674 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.075910 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.076126 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.076375 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.076619 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.076871 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.077103 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.077347 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.077583 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.077796 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.078033 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] log_file = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.078190 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] log_options = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.078419 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.078699 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.078948 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.079146 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.079386 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.079526 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.079719 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.079877 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.080125 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.080335 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.080543 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.080791 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.081317 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.081531 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.081766 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.082007 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.082217 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.082430 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.082708 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.082966 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.083138 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.083660 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.083660 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.083873 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.084098 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.084308 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.084553 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.084762 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.084997 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.085231 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.085472 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.085722 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.085950 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.086191 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.086459 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.086723 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.100216 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.100216 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.100216 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.100216 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.100216 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.100216 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.100216 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.100216 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.101365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.101365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.101365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] use_json = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.101365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.101365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.101365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.101365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.101365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.101365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.102502 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.102502 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.102502 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.102502 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.102502 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.102502 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.102502 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.102502 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.103548 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.103548 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.103548 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.103548 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.103548 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.103548 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.103548 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.103548 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.104559 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.104559 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.104559 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.104559 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.104559 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.104559 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.104559 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.104559 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.105581 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.105581 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.105581 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.105581 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.105581 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.105581 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.105581 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.105581 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.16/identity {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.106596 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.106596 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.106596 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.106596 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.106596 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.106596 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.106596 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.106596 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.108198 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.108198 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.108198 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.108198 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.108198 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.108198 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.108198 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.108198 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.110289 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.110289 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.110289 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.110289 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.110289 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.110289 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.110289 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.110289 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.110289 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.114951 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.114951 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.114951 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.114951 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.114951 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.114951 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.114951 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.114951 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.115996 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 53636) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:05:19.116100 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.116100 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.116100 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.116100 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.116100 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.116100 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.116100 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.116100 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.116100 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.121536 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.128707 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.128707 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.128707 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.128707 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.128707 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.128707 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.128707 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.128707 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.128707 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.129614 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.129692 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [-] 10.222.0.16 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0091686 Nov 11 17:05:19.129765 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.129765 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.129765 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.129765 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.129765 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.129765 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.129765 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.129765 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.130338 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.130338 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.130338 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.130338 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.130338 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.130338 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.130338 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.130338 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.130968 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.130968 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.130968 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.130968 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.130968 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.130968 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.130968 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.130968 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.131455 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.131455 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.131455 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.131455 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.131455 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.131455 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.131809 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.131877 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.132091 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.132393 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.132633 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.132934 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.133152 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.133477 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.133811 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.134105 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.134469 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.134819 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.135061 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.135340 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.135619 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.135895 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.137299 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.137587 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.137816 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.138105 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.138357 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.138645 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.138916 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.139116 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.139449 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.139700 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.139929 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.140130 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.140395 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.140664 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.140896 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.141152 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.141397 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.141624 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.141872 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.142137 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.16/identity {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.142351 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.143570 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.143839 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.144052 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.144306 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.144540 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.144781 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.145012 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.145225 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.145475 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.145752 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.146659 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.146659 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.146659 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.146659 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.150365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.150365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.150365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.150365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.150365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.150365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.150365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.150365 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.151218 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.151218 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.151218 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.151218 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.151218 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.151218 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.151218 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.151218 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.152111 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.152111 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.152111 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.152111 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.152111 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.152111 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.152111 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.152111 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.152959 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.152959 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.152959 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.152959 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.153359 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.153359 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.153564 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.153705 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.153928 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.154163 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.154375 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.154622 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.154841 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.155076 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.155328 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.155571 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.155973 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.156346 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.156713 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.157088 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.157313 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.157523 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.157732 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.158022 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.158423 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.158689 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.160386 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.160386 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.160386 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.160386 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.160714 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.160714 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.160876 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.161477 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.161477 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.161477 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.161691 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.161833 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.162245 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.162462 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.162697 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.163208 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.163208 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.163500 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.163691 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.163838 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.163987 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.164275 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.164433 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.164590 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.165058 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.165273 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.165480 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.165704 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.165940 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.166148 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.166388 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.166663 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.166871 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.167178 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.168188 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.168188 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.168188 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.168188 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.168505 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.168661 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.168986 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.169252 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.169496 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.169714 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.169950 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.170186 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.170437 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.170768 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.171067 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.171974 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.171974 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.171974 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.172233 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:500:549'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.172364 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.172600 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.172894 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.173223 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.173498 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.173766 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.174006 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.174259 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.174482 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.176939 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.176939 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.176939 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.176939 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.181654 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.181654 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.181654 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.181654 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.181654 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.181654 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.181654 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.181654 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.181654 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.182207 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.182207 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 17:05:19.182207 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102214) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 11 17:05:19.182207 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 17:05:19.182207 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 17:05:19.182207 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 17:05:19.182207 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 17:05:19.182207 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 17:05:19.182687 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.182687 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.182854 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.183320 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.183639 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.183978 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.184141 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.184947 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.184947 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.184947 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.184947 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.184947 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.185292 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.185493 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.185779 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.186065 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.186340 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.186525 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.187525 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.187877 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.188035 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.188327 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.188632 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] debug = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.188924 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.189247 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.189579 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.189732 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.190032 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.190254 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.191074 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.191074 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.191074 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.191074 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.191074 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.191390 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.191390 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.191509 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.191591 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.191758 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.191892 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.192049 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.192204 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] host = dv-cinder-694140-2-iscsi {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.192360 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.192515 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.192671 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.194270 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.194462 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.194659 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.194971 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.195287 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.195585 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.196525 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.197321 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.197446 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.197593 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.197751 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] log_file = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.197910 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] log_options = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.198068 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.198226 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.198384 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.198589 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.198753 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.198910 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.199066 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.199222 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.199377 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.199531 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.199689 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.199843 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.200976 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.200976 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.200976 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.200976 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.200976 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.200976 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.200976 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.201466 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.201466 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.201466 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.201466 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.201685 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.201759 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.202016 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.202016 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.202163 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.202413 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.202506 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.203247 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.203247 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.203247 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.203247 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.203247 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.203581 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.203581 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.203700 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.203809 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.203958 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.204106 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.205060 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.205060 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.205060 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.205060 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.205060 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.205060 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] use_json = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.205669 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.205669 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.205669 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.205669 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.206088 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.206088 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.206088 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.206374 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 17:05:19.206478 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.206628 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.206739 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.207695 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.207695 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.207695 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.207695 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.207695 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.207695 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.208831 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.208831 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.208831 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.209118 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.209118 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.209320 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.209320 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.209516 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.209621 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.210964 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.210964 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.210964 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.210964 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.210964 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.210964 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.210964 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.210964 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.216694 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.216694 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.216694 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.216694 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.16/identity {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.216694 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.216694 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.216694 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.216694 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217142 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217142 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217142 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217142 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217142 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217142 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217142 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217142 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217142 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217743 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217743 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217743 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217743 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217743 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217743 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217743 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217743 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.217743 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218239 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218239 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218239 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218239 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218239 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218239 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218239 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218239 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218239 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218882 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218882 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218882 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218882 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218882 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218882 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218882 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218882 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.218882 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.219515 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.219515 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.219515 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.219515 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.219515 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.219515 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.219515 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.219515 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.219515 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.220105 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.220105 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.220105 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.220105 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.220369 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.220369 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.220509 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.220655 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.220737 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.221074 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.221074 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.221337 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.222009 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.222196 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.222353 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.222505 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.222718 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.222844 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.222986 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.223138 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.223289 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.223441 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.223608 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.223765 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.223922 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.224075 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.224387 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.224724 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.225063 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.225250 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.225379 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.225563 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.225730 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.225891 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.225993 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.226151 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.226347 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.226628 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.227540 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.227731 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.227858 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.228173 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.228497 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.228686 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.228838 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.228981 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.229135 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.229278 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.229437 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.229586 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.229738 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.229910 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.230037 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.230210 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.230380 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.230590 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.230737 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.230895 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.231084 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.231233 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.231425 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.231532 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.231693 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.231867 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.232008 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.232168 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.232328 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.232485 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.232644 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.232805 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.16/identity {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.232955 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.233115 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.233272 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.233431 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.233589 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.233998 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.234160 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.234319 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.234478 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.234673 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.234826 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.234980 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.235132 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.235295 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.235516 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.235615 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.235742 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.235903 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.236081 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.236236 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.236371 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.236528 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.236687 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.236843 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.237124 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.237798 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.237952 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.238745 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.238954 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.239122 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.239264 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.239435 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.240164 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.240493 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.240654 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.240795 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.240951 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.241102 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.241351 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.241496 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.241634 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.241780 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.241951 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.242124 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.242281 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.242433 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.242597 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.242743 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.242898 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.243042 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.243198 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.243355 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.243552 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.243707 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.243866 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.244019 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.244160 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.244298 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.244437 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.244575 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.244713 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.244851 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.244989 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.245138 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.245278 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.245416 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.245581 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.245728 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.245868 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.246017 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.246157 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.246311 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.246462 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.246657 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.246820 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.247262 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.247262 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.247262 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.247684 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.247684 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.247948 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.247948 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.248236 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.248236 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.248501 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.248501 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.248762 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.248762 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.249024 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.249976 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.249976 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.249976 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.249976 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.250274 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.250453 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.250784 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.251169 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.251460 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.251751 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.252155 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.252457 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.253327 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.253509 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.253644 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.254390 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.254390 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.254390 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.254390 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.254390 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.254769 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.254769 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.254890 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.255114 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.255208 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.255361 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.255506 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.255649 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.255803 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:500:549'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.255965 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.256116 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.256282 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.256455 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.256617 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.256767 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.256926 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.257076 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.257229 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.257388 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.257544 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.257698 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.257855 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.258010 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.258166 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.258321 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.259195 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.259195 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.259195 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.259422 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.259422 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.259544 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.259665 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 17:05:19.259863 dv-cinder-694140-2-iscsi neutron-server[102214]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 17:05:19.279892 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:05:30.980817 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3b3e226-ed19-440d-9f38-12ad92edd05d None None] get_active_networks_info from dv-cinder-694140-2-iscsi {{(pid=102325) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 11 17:05:31.095002 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3b3e226-ed19-440d-9f38-12ad92edd05d None None] No non-hosted networks {{(pid=102325) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 11 17:05:31.106952 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.agentschedulers_db [None req-e3b3e226-ed19-440d-9f38-12ad92edd05d None None] DHCP Agent not found on host dv-cinder-694140-2-iscsi {{(pid=102325) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Nov 11 17:05:31.250078 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-38298e00-d979-4345-a861-4089b4a54f13 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-393800'] for agent, after_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:33.514697 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c7b6ccf4-1a6f-4ce4-8d65-2c525fef5e86 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-393800'] for agent, after_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:33.553808 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.db.api [None req-fcbd9b65-8a89-4110-887f-f4b9bd231fff None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agent_type', 'host'] with value(s) L3 agent-dv-cinder-694140-2-iscsi {{(pid=102325) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 11 17:05:33.554647 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG oslo_db.api [None req-fcbd9b65-8a89-4110-887f-f4b9bd231fff None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 11 17:05:34.221940 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fcbd9b65-8a89-4110-887f-f4b9bd231fff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:34.605893 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-393800'] for agent, after_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:36.336568 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-393800'] for agent, after_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:36.528064 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.db.l3_hamode_db [None req-8c655db3-bdd8-4663-833e-3e28e4c78a29 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 11 17:05:36.608881 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c655db3-bdd8-4663-833e-3e28e4c78a29 None None] Routers set() bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:05:36.609651 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c655db3-bdd8-4663-833e-3e28e4c78a29 None None] Router IDs set() for agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 11 17:05:36.970389 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-393800'] for agent, after_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:36.971245 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:36.971629 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:36.972029 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:36.972474 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:36.972895 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:36.973285 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:36.973677 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:36.974689 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:36.975087 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:36.975481 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:36.975919 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:36.976411 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:36.976948 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-694140-2-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:05:36.984593 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-694140-2-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:05:37.615824 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 53740) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:05:38.118454 dv-cinder-694140-2-iscsi neutron-server[102323]: WARNING oslo_policy.policy [None req-7338e089-d245-4e05-8f16-16a1d936bbf7 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 11 17:05:38.119071 dv-cinder-694140-2-iscsi neutron-server[102323]: WARNING oslo_policy.policy [None req-7338e089-d245-4e05-8f16-16a1d936bbf7 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 11 17:05:38.346315 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [None req-7338e089-d245-4e05-8f16-16a1d936bbf7 admin admin] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=102323) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 17:05:38.347396 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-7338e089-d245-4e05-8f16-16a1d936bbf7 admin admin] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7306538 Nov 11 17:05:40.946927 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 53756) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:05:41.262600 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-99fcaaae-0b76-4c49-8ee9-f09400c06364 admin admin] Request body: {'subnetpool': {'shared': True, 'prefixes': ['172.20.0.0/16'], 'name': 'shared-default-subnetpool-v4', 'is_default': True, 'default_prefixlen': 26}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:05:41.358179 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.policy [None req-99fcaaae-0b76-4c49-8ee9-f09400c06364 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102323) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 11 17:05:41.405459 dv-cinder-694140-2-iscsi neutron-server[102323]: WARNING oslo_policy.policy [None req-99fcaaae-0b76-4c49-8ee9-f09400c06364 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 11 17:05:41.405842 dv-cinder-694140-2-iscsi neutron-server[102323]: WARNING oslo_policy.policy [None req-99fcaaae-0b76-4c49-8ee9-f09400c06364 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 11 17:05:41.414638 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.quota [None req-99fcaaae-0b76-4c49-8ee9-f09400c06364 admin admin] Loaded quota_driver: . Nov 11 17:05:41.575774 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-99fcaaae-0b76-4c49-8ee9-f09400c06364 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8735341673577', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8735341673030', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8735341661304', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8735341658116', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8735340011473', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8735341638896', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-694787', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-7652253', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-519655', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-447389'] for rbac-policy, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:41.782555 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-99fcaaae-0b76-4c49-8ee9-f09400c06364 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:41.783807 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-99fcaaae-0b76-4c49-8ee9-f09400c06364 admin admin] 10.222.0.16 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.8359764 Nov 11 17:05:44.624065 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 53768) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:05:45.162631 dv-cinder-694140-2-iscsi neutron-server[102324]: WARNING oslo_policy.policy [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 11 17:05:45.163564 dv-cinder-694140-2-iscsi neutron-server[102324]: WARNING oslo_policy.policy [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 11 17:05:45.594623 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Request body: {'network': {'tenant_id': '4b30188d19194873aed7f02c87d439bb', 'project_id': '4b30188d19194873aed7f02c87d439bb', 'admin_state_up': True, 'name': 'private'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:05:45.597313 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.quota [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Loaded quota_driver: . Nov 11 17:05:45.731208 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Made reservation on behalf of 4b30188d19194873aed7f02c87d439bb for: {'network': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:05:45.807858 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.policy [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102324) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 11 17:05:45.855402 dv-cinder-694140-2-iscsi neutron-server[102324]: WARNING oslo_policy.policy [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 11 17:05:45.855743 dv-cinder-694140-2-iscsi neutron-server[102324]: WARNING oslo_policy.policy [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 11 17:05:45.867708 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:45.889626 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:46.018419 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:46.074117 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:46.101679 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] vlan segment allocate from pool success with {'vlan_id': 546, 'physical_network': 'physnet1'} {{(pid=102324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:05:46.125686 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d62d1ca7-791b-4f57-970b-64bd78a46328,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:05:46.143149 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:46.143511 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:46.143851 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:46.144186 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:46.144512 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:46.144878 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:46.145184 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:46.145567 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:46.145912 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:46.146235 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:46.146567 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:46.146910 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Tracked resource versions report: Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: pushed versions: Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: { 'AddressGroup': {'1.2'}, Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'ConntrackHelper': {'1.0'}, Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Log': {'1.0'}, Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Network': {'1.1'}, Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Port': {'1.7'}, Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'PortForwarding': {'1.2'}, Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'QosPolicy': {'1.10'}, Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'SecurityGroup': {'1.5'}, Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'SecurityGroupRule': {'1.2'}, Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'SubPort': {'1.0'}, Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Subnet': {'1.1'}, Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Trunk': {'1.1'}} Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: consumer versions: Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: { DHCP agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: L3 agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: Metadata agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: Metering agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: Open vSwitch agent@dv-cinder-694140-2-iscsi: { 'AddressGroup': '1.2', Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'ConntrackHelper': '1.0', Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Log': '1.0', Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Network': '1.1', Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Port': '1.7', Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'PortForwarding': '1.2', Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'QosPolicy': '1.10', Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'SecurityGroup': '1.5', Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'SecurityGroupRule': '1.2', Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'SubPort': '1.0', Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Subnet': '1.1', Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Trunk': '1.1'}} Nov 11 17:05:46.148183 dv-cinder-694140-2-iscsi neutron-server[102324]: {{(pid=102324) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 11 17:05:46.188456 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8735338596316', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:46.189058 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Unsubscribe: segment precommit_create {{(pid=102324) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 11 17:05:46.189582 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.segments_db [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Added segment 92e24367-cb3e-4c34-88f8-6fa5996e139c of type vlan for network 287eed58-093a-4d80-ac58-d3ed35cf1f80 Nov 11 17:05:46.280856 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:46.392608 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:46.393799 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:05:46.394589 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:46.519614 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] Pushing event updated for resources: {'Network': ['ID=287eed58-093a-4d80-ac58-d3ed35cf1f80,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:05:46.533733 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network 287eed58-093a-4d80-ac58-d3ed35cf1f80 details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:05:46.557231 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-ab3c03ba-ae43-4613-b48c-0cf0b3d5998b admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 1.9307635 Nov 11 17:05:49.435903 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 53790) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:05:49.842611 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af5aed25-1143-4d5e-8aaa-cdba78377b35 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:05:49.843986 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-af5aed25-1143-4d5e-8aaa-cdba78377b35 admin admin] 10.222.0.16 "GET /v2.0/networks/287eed58-093a-4d80-ac58-d3ed35cf1f80 HTTP/1.1" status: 200 len: 825 time: 0.4069772 Nov 11 17:05:49.893078 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-0daf549d-7b54-4d57-b465-0b9703e2a0f8 admin admin] 10.222.0.16 "GET /v2.0/subnetpools/5913535f-0924-4428-8c3d-4795619b56bc HTTP/1.1" status: 200 len: 734 time: 0.0427105 Nov 11 17:05:49.902694 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-760c9be0-bb93-4c84-80ba-ea16646caee9 admin admin] Request body: {'subnet': {'gateway_ip': '172.20.0.1', 'tenant_id': '4b30188d19194873aed7f02c87d439bb', 'ip_version': 4, 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80', 'name': 'private-subnet', 'subnetpool_id': '5913535f-0924-4428-8c3d-4795619b56bc'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:05:49.997599 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-760c9be0-bb93-4c84-80ba-ea16646caee9 admin admin] Made reservation on behalf of 4b30188d19194873aed7f02c87d439bb for: {'subnet': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:05:49.999949 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-760c9be0-bb93-4c84-80ba-ea16646caee9 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:50.392577 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-760c9be0-bb93-4c84-80ba-ea16646caee9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for subnet, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:50.461194 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-760c9be0-bb93-4c84-80ba-ea16646caee9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=112c7908-febb-40e6-a757-429bad49c61e,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:05:50.465196 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-760c9be0-bb93-4c84-80ba-ea16646caee9 admin admin] Checking segment: {'id': '92e24367-cb3e-4c34-88f8-6fa5996e139c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:05:50.465576 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-760c9be0-bb93-4c84-80ba-ea16646caee9 admin admin] Network hostable DHCP agents. Network: 287eed58-093a-4d80-ac58-d3ed35cf1f80, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:05:50.582414 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-760c9be0-bb93-4c84-80ba-ea16646caee9 admin admin] Network 287eed58-093a-4d80-ac58-d3ed35cf1f80 is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:05:50.645183 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-760c9be0-bb93-4c84-80ba-ea16646caee9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, 287eed58-093a-4d80-ac58-d3ed35cf1f80) {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:05:50.650702 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-760c9be0-bb93-4c84-80ba-ea16646caee9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:05:50.651309 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-760c9be0-bb93-4c84-80ba-ea16646caee9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:50.655290 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed27353d-2f40-42b8-a56d-e166c4bc34ba None None] Network 287eed58-093a-4d80-ac58-d3ed35cf1f80 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:05:50.722586 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-760c9be0-bb93-4c84-80ba-ea16646caee9 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.8230588 Nov 11 17:05:50.990202 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaac6311d-333a-5f5f-a33c-91960009c34a-287eed58-093a-4d80-ac58-d3ed35cf1f80', 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80', 'tenant_id': '4b30188d19194873aed7f02c87d439bb', 'fixed_ips': [{'subnet_id': '112c7908-febb-40e6-a757-429bad49c61e'}]}} from dv-cinder-694140-2-iscsi. {{(pid=102325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 17:05:50.991532 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:51.308804 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.db_base_plugin_common [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Allocated IP 172.20.0.2 (287eed58-093a-4d80-ac58-d3ed35cf1f80/112c7908-febb-40e6-a757-429bad49c61e/b23dc5e5-826c-4c0c-baef-547609ced676) {{(pid=102325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:05:51.521125 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Publish callbacks [] for port, precommit_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:51.590424 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624'] for port, after_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:51.666358 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Network 287eed58-093a-4d80-ac58-d3ed35cf1f80 is already hosted by enough agents. {{(pid=102325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:05:51.674760 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.base_scheduler [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Resources bound (agent type, host, resource id): {{(pid=102325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:05:51.680223 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Pushing event updated for resources: {'Port': ['ID=b23dc5e5-826c-4c0c-baef-547609ced676,revision_number=1']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:05:51.682348 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Received port after_create {{(pid=102325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:05:51.692031 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:51.692936 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:51.693263 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:51.693593 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:51.693917 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:51.694236 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:51.694568 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:51.694893 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:51.695229 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:51.695546 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:51.695859 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:51.696171 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Tracked resource versions report: Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: pushed versions: Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: { 'AddressGroup': {'1.2'}, Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'ConntrackHelper': {'1.0'}, Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Log': {'1.0'}, Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Network': {'1.1'}, Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Port': {'1.7'}, Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'PortForwarding': {'1.2'}, Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'QosPolicy': {'1.10'}, Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'SecurityGroup': {'1.5'}, Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'SecurityGroupRule': {'1.2'}, Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'SubPort': {'1.0'}, Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Subnet': {'1.1'}, Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Trunk': {'1.1'}} Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: consumer versions: Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: { DHCP agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: L3 agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: Metadata agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: Metering agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: Open vSwitch agent@dv-cinder-694140-2-iscsi: { 'AddressGroup': '1.2', Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'ConntrackHelper': '1.0', Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Log': '1.0', Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Network': '1.1', Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Port': '1.7', Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'PortForwarding': '1.2', Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'QosPolicy': '1.10', Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'SecurityGroup': '1.5', Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'SecurityGroupRule': '1.2', Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'SubPort': '1.0', Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Subnet': '1.1', Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Trunk': '1.1'}} Nov 11 17:05:51.697234 dv-cinder-694140-2-iscsi neutron-server[102325]: {{(pid=102325) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 11 17:05:51.768766 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Attempting to bind port b23dc5e5-826c-4c0c-baef-547609ced676 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:05:51.769163 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Attempting to bind port b23dc5e5-826c-4c0c-baef-547609ced676 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '92e24367-cb3e-4c34-88f8-6fa5996e139c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:05:51.769633 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Attempting to bind port b23dc5e5-826c-4c0c-baef-547609ced676 on network 287eed58-093a-4d80-ac58-d3ed35cf1f80 {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:05:51.776109 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 5, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:05:51.776486 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Checking segment: {'id': '92e24367-cb3e-4c34-88f8-6fa5996e139c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:05:51.776981 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:51.777371 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Bound using segment: {'id': '92e24367-cb3e-4c34-88f8-6fa5996e139c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:05:51.777888 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Bound port: b23dc5e5-826c-4c0c-baef-547609ced676, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '92e24367-cb3e-4c34-88f8-6fa5996e139c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:05:51.778316 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:51.850411 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] For port b23dc5e5-826c-4c0c-baef-547609ced676, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:05:51.854793 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] For port b23dc5e5-826c-4c0c-baef-547609ced676, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=b23dc5e5-826c-4c0c-baef-547609ced676,segment=NetworkSegment(92e24367-cb3e-4c34-88f8-6fa5996e139c),segment_id=92e24367-cb3e-4c34-88f8-6fa5996e139c)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:05:51.954512 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:05:52.021227 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7e027ff-08ab-4f9b-8957-c346256f2796 None None] Pushing event updated for resources: {'Port': ['ID=b23dc5e5-826c-4c0c-baef-547609ced676,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:05:53.391036 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 53798) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:05:53.874496 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [None req-6892176d-02b1-4c91-bdb0-46707786e564 admin admin] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=102323) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 17:05:53.875846 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-6892176d-02b1-4c91-bdb0-46707786e564 admin admin] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.4835424 Nov 11 17:05:56.576657 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 53806) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:05:57.079677 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [None req-07cb0bed-a867-49fd-a84d-8c14cca13b2a admin admin] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=102323) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 17:05:57.080756 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-07cb0bed-a867-49fd-a84d-8c14cca13b2a admin admin] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.5029507 Nov 11 17:06:00.425679 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 53816) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:06:00.873613 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-47566710-1801-411b-a021-1af974f80062 admin admin] Request body: {'router': {'tenant_id': '4b30188d19194873aed7f02c87d439bb', 'admin_state_up': True, 'name': 'router1'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:06:00.966498 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-47566710-1801-411b-a021-1af974f80062 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-424378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7339'] for router, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:00.968466 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-47566710-1801-411b-a021-1af974f80062 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-424390', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-397156', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7867629', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7328'] for router, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:00.988711 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-2688a38b-1774-4aa9-aae9-95a4cd6da3f2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:01.129516 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-47566710-1801-411b-a021-1af974f80062 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:01.206600 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-47566710-1801-411b-a021-1af974f80062 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-424501', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-397235'] for router, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:01.223553 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 5 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:06:01.288741 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-47566710-1801-411b-a021-1af974f80062 admin admin] Publish callbacks [] for router, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:01.290041 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-47566710-1801-411b-a021-1af974f80062 admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.8629072 Nov 11 17:06:02.198918 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2217899-ab86-43c3-9e80-48dea794f9db None None] Network 287eed58-093a-4d80-ac58-d3ed35cf1f80 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:06:02.273146 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-0b4da2cc-0243-4c43-9308-e7e6d76d1e2f None None] Provisioning complete for port b23dc5e5-826c-4c0c-baef-547609ced676 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:06:02.273542 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-0b4da2cc-0243-4c43-9308-e7e6d76d1e2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:02.502943 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-0b4da2cc-0243-4c43-9308-e7e6d76d1e2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:02.558136 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-0b4da2cc-0243-4c43-9308-e7e6d76d1e2f None None] For port b23dc5e5-826c-4c0c-baef-547609ced676, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=b23dc5e5-826c-4c0c-baef-547609ced676,segment=NetworkSegment(92e24367-cb3e-4c34-88f8-6fa5996e139c),segment_id=92e24367-cb3e-4c34-88f8-6fa5996e139c)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:06:02.634937 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-0b4da2cc-0243-4c43-9308-e7e6d76d1e2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:02.713649 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b4da2cc-0243-4c43-9308-e7e6d76d1e2f None None] Pushing event updated for resources: {'Port': ['ID=b23dc5e5-826c-4c0c-baef-547609ced676,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:06:02.831228 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device b23dc5e5-826c-4c0c-baef-547609ced676 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:06:02.910367 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-88bad745-40dd-4bbe-8ad4-cf44f8f37fdd None None] Provisioning complete for port b23dc5e5-826c-4c0c-baef-547609ced676 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:06:02.910918 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-88bad745-40dd-4bbe-8ad4-cf44f8f37fdd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:02.997135 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port b23dc5e5-826c-4c0c-baef-547609ced676 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:06:02.997725 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:03.478418 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ff81b237-2629-4612-bff3-49942d24097c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:03.957324 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 53828) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:06:04.426581 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [None req-9edff45f-9b57-440a-baf6-d69077c71b67 admin admin] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=102323) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 17:06:04.428576 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-9edff45f-9b57-440a-baf6-d69077c71b67 admin admin] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.4698267 Nov 11 17:06:04.490652 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:04.770639 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device b23dc5e5-826c-4c0c-baef-547609ced676 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:06:04.835151 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port b23dc5e5-826c-4c0c-baef-547609ced676 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:06:04.835603 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:06.200773 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:06.990111 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:07.035410 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 53846) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:06:07.180440 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-340ebc92-7547-45a6-9e2b-690a4ea448c2 admin admin] Request body: {'network': {'provider:physical_network': 'physnet1', 'is_default': True, 'admin_state_up': True, 'provider:network_type': 'flat', 'router:external': True, 'name': 'public'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:06:07.269061 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-340ebc92-7547-45a6-9e2b-690a4ea448c2 admin admin] Made reservation on behalf of a62f9c4d0b7f4443a8eb78e076640010 for: {'network': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:06:07.271661 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-340ebc92-7547-45a6-9e2b-690a4ea448c2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:07.281240 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-340ebc92-7547-45a6-9e2b-690a4ea448c2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:07.372538 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-340ebc92-7547-45a6-9e2b-690a4ea448c2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:07.421395 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-340ebc92-7547-45a6-9e2b-690a4ea448c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:07.440540 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-340ebc92-7547-45a6-9e2b-690a4ea448c2 admin admin] Reserving flat network on physical network physnet1 {{(pid=102324) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 11 17:06:07.457502 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-340ebc92-7547-45a6-9e2b-690a4ea448c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ad42160-4d4b-4925-95dd-dbb626abd117,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:06:07.462840 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-340ebc92-7547-45a6-9e2b-690a4ea448c2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:07.463175 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.segments_db [None req-340ebc92-7547-45a6-9e2b-690a4ea448c2 admin admin] Added segment 7424c811-7de6-42e6-8320-5f665532ffaf of type flat for network 78b17769-6fae-453e-8ae3-4a72e72bccfc Nov 11 17:06:07.527569 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-340ebc92-7547-45a6-9e2b-690a4ea448c2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:07.617312 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-340ebc92-7547-45a6-9e2b-690a4ea448c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:07.618468 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-340ebc92-7547-45a6-9e2b-690a4ea448c2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:06:07.619159 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-340ebc92-7547-45a6-9e2b-690a4ea448c2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:07.683880 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-340ebc92-7547-45a6-9e2b-690a4ea448c2 admin admin] Pushing event updated for resources: {'Network': ['ID=78b17769-6fae-453e-8ae3-4a72e72bccfc,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:06:07.694895 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:06:07.719351 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-340ebc92-7547-45a6-9e2b-690a4ea448c2 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.6822891 Nov 11 17:06:10.214085 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 53864) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:06:10.315812 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-443d7442-6f54-4515-bcf7-9fea0097688d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:06:10.317418 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-443d7442-6f54-4515-bcf7-9fea0097688d admin admin] 10.222.0.16 "GET /v2.0/subnets/112c7908-febb-40e6-a757-429bad49c61e HTTP/1.1" status: 200 len: 849 time: 0.1018476 Nov 11 17:06:10.496701 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-d0b4a0f3-a7f2-43df-b599-ef77f4eb1dfa admin admin] 10.222.0.16 "GET /v2.0/routers/c8e73331-1ed4-4ae2-9730-43fe15ad66e8 HTTP/1.1" status: 200 len: 704 time: 0.1718934 Nov 11 17:06:10.799387 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:11.114025 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Allocated IP 172.20.0.1 (287eed58-093a-4d80-ac58-d3ed35cf1f80/112c7908-febb-40e6-a757-429bad49c61e/60677f73-0028-4dbc-bfb7-3ea816ac814e) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:06:11.358470 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:11.555479 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:11.630964 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Network 287eed58-093a-4d80-ac58-d3ed35cf1f80 is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:06:11.638166 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:06:11.644614 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:06:11.645158 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-394084'] for router_interface, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:11.672102 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Pushing event updated for resources: {'Port': ['ID=60677f73-0028-4dbc-bfb7-3ea816ac814e,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:06:11.896924 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-f96f7233-fa84-42b4-913c-a2b5becb0aab None None] Provisioning complete for port 60677f73-0028-4dbc-bfb7-3ea816ac814e triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:06:11.897839 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-f96f7233-fa84-42b4-913c-a2b5becb0aab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:11.937060 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-f96f7233-fa84-42b4-913c-a2b5becb0aab None None] Port 60677f73-0028-4dbc-bfb7-3ea816ac814e cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:06:11.938668 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:12.159139 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:12.245651 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:12.246492 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8103788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-394224'] for router_interface, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:12.329037 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Pushing event updated for resources: {'Port': ['ID=60677f73-0028-4dbc-bfb7-3ea816ac814e,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:06:12.375158 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Network 287eed58-093a-4d80-ac58-d3ed35cf1f80 is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:06:12.376458 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:06:12.646852 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Router c8e73331-1ed4-4ae2-9730-43fe15ad66e8 is scheduled to L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 with binding_index 1 {{(pid=102324) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 17:06:12.672133 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-82095f33-125e-4e35-826b-b3353f4a7c67 None None] Provisioning complete for port 60677f73-0028-4dbc-bfb7-3ea816ac814e triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:06:12.672890 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-82095f33-125e-4e35-826b-b3353f4a7c67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:12.728653 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-82095f33-125e-4e35-826b-b3353f4a7c67 None None] Port 60677f73-0028-4dbc-bfb7-3ea816ac814e cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:06:12.774315 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:06:12.780113 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-f97dcd3c-f4c4-4bad-ae0e-f0c7c08155f8 admin admin] 10.222.0.16 "PUT /v2.0/routers/c8e73331-1ed4-4ae2-9730-43fe15ad66e8/add_router_interface HTTP/1.1" status: 200 len: 508 time: 2.2726984 Nov 11 17:06:12.789174 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Sync routers for ids ['c8e73331-1ed4-4ae2-9730-43fe15ad66e8'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:06:12.803810 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Routers {'c8e73331-1ed4-4ae2-9730-43fe15ad66e8'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:06:12.804786 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:06:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['c8e73331-1ed4-4ae2-9730-43fe15ad66e8'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:06:13.044538 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Set router c8e73331-1ed4-4ae2-9730-43fe15ad66e8 gateway port host: None {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:06:13.634735 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c8e73331-1ed4-4ae2-9730-43fe15ad66e8', 'name': 'router1', 'tenant_id': '4b30188d19194873aed7f02c87d439bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:06:00Z', 'updated_at': '2021-11-11T17:06:11Z', 'revision_number': 2, 'project_id': '4b30188d19194873aed7f02c87d439bb', 'gw_port_host': None, '_interfaces': [{'id': '60677f73-0028-4dbc-bfb7-3ea816ac814e', 'name': '', 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80', 'tenant_id': '4b30188d19194873aed7f02c87d439bb', 'mac_address': 'fa:16:3e:79:96:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c8e73331-1ed4-4ae2-9730-43fe15ad66e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '112c7908-febb-40e6-a757-429bad49c61e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:06:10Z', 'updated_at': '2021-11-11T17:06:12Z', 'revision_number': 2, 'project_id': '4b30188d19194873aed7f02c87d439bb', 'subnets': [{'id': '112c7908-febb-40e6-a757-429bad49c61e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5913535f-0924-4428-8c3d-4795619b56bc'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:06:13.729067 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Checking router: c8e73331-1ed4-4ae2-9730-43fe15ad66e8 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:06:13.729588 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Updating router c8e73331-1ed4-4ae2-9730-43fe15ad66e8 port 60677f73-0028-4dbc-bfb7-3ea816ac814e binding host dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:06:13.821610 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:14.498859 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Publish callbacks [] for port, precommit_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:14.629151 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:14.832032 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98859258-1e83-49c9-864c-5df971ca2cdc None None] Pushing event updated for resources: {'Port': ['ID=60677f73-0028-4dbc-bfb7-3ea816ac814e,revision_number=3']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:06:14.855330 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98859258-1e83-49c9-864c-5df971ca2cdc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:06:14.855828 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98859258-1e83-49c9-864c-5df971ca2cdc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:06:14.856266 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98859258-1e83-49c9-864c-5df971ca2cdc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:06:14.856949 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98859258-1e83-49c9-864c-5df971ca2cdc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:06:14.857487 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98859258-1e83-49c9-864c-5df971ca2cdc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:06:14.858008 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98859258-1e83-49c9-864c-5df971ca2cdc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:06:14.858454 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98859258-1e83-49c9-864c-5df971ca2cdc None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:06:14.862530 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98859258-1e83-49c9-864c-5df971ca2cdc None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:06:14.862530 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98859258-1e83-49c9-864c-5df971ca2cdc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:06:14.862530 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98859258-1e83-49c9-864c-5df971ca2cdc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:06:14.862530 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98859258-1e83-49c9-864c-5df971ca2cdc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:06:14.862530 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98859258-1e83-49c9-864c-5df971ca2cdc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98859258-1e83-49c9-864c-5df971ca2cdc None None] Tracked resource versions report: Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: pushed versions: Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: { 'AddressGroup': {'1.2'}, Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'ConntrackHelper': {'1.0'}, Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Log': {'1.0'}, Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Network': {'1.1'}, Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Port': {'1.7'}, Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'PortForwarding': {'1.2'}, Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'QosPolicy': {'1.10'}, Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'SecurityGroup': {'1.5'}, Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'SecurityGroupRule': {'1.2'}, Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'SubPort': {'1.0'}, Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Subnet': {'1.1'}, Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Trunk': {'1.1'}} Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: consumer versions: Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: { DHCP agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: L3 agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: Metadata agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: Metering agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: Open vSwitch agent@dv-cinder-694140-2-iscsi: { 'AddressGroup': '1.2', Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'ConntrackHelper': '1.0', Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Log': '1.0', Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Network': '1.1', Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Port': '1.7', Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'PortForwarding': '1.2', Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'QosPolicy': '1.10', Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'SecurityGroup': '1.5', Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'SecurityGroupRule': '1.2', Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'SubPort': '1.0', Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Subnet': '1.1', Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Trunk': '1.1'}} Nov 11 17:06:14.863282 dv-cinder-694140-2-iscsi neutron-server[102326]: {{(pid=102326) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 11 17:06:14.868920 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Attempting to bind port 60677f73-0028-4dbc-bfb7-3ea816ac814e on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:06:14.868920 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Attempting to bind port 60677f73-0028-4dbc-bfb7-3ea816ac814e by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '92e24367-cb3e-4c34-88f8-6fa5996e139c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80'}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:06:14.868920 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Attempting to bind port 60677f73-0028-4dbc-bfb7-3ea816ac814e on network 287eed58-093a-4d80-ac58-d3ed35cf1f80 {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:06:14.877251 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 6, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:06:14.877827 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Checking segment: {'id': '92e24367-cb3e-4c34-88f8-6fa5996e139c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:06:14.878641 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:14.879138 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Bound using segment: {'id': '92e24367-cb3e-4c34-88f8-6fa5996e139c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80'} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:06:14.879805 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Bound port: 60677f73-0028-4dbc-bfb7-3ea816ac814e, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '92e24367-cb3e-4c34-88f8-6fa5996e139c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80'}}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:06:14.880893 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:14.971974 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-055d845b-7083-4f8f-993b-057dca07c9f5 None None] Provisioning complete for port 60677f73-0028-4dbc-bfb7-3ea816ac814e triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:06:14.973130 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] For port 60677f73-0028-4dbc-bfb7-3ea816ac814e, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:06:14.973499 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-055d845b-7083-4f8f-993b-057dca07c9f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:15.006859 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] For port 60677f73-0028-4dbc-bfb7-3ea816ac814e, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=60677f73-0028-4dbc-bfb7-3ea816ac814e,segment=NetworkSegment(92e24367-cb3e-4c34-88f8-6fa5996e139c),segment_id=92e24367-cb3e-4c34-88f8-6fa5996e139c)] {{(pid=102326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:06:15.028307 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-055d845b-7083-4f8f-993b-057dca07c9f5 None None] Port 60677f73-0028-4dbc-bfb7-3ea816ac814e cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:06:15.107685 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:15.176262 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Routers {'c8e73331-1ed4-4ae2-9730-43fe15ad66e8'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:06:15.184047 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:06:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['c8e73331-1ed4-4ae2-9730-43fe15ad66e8'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:06:15.184047 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98859258-1e83-49c9-864c-5df971ca2cdc None None] Pushing event updated for resources: {'Port': ['ID=60677f73-0028-4dbc-bfb7-3ea816ac814e,revision_number=4']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:06:15.288091 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] Set router c8e73331-1ed4-4ae2-9730-43fe15ad66e8 gateway port host: None {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:06:15.390477 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 53874) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:06:15.457589 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-b4f61428-61d8-4106-b766-ce99d00eab24 None None] Provisioning complete for port 60677f73-0028-4dbc-bfb7-3ea816ac814e triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:06:15.458343 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b4f61428-61d8-4106-b766-ce99d00eab24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:15.510123 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19f0cb5e-21d0-42ef-bbd1-09316fe32e92 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:06:15.513547 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-19f0cb5e-21d0-42ef-bbd1-09316fe32e92 admin admin] 10.222.0.16 "GET /v2.0/networks/78b17769-6fae-453e-8ae3-4a72e72bccfc HTTP/1.1" status: 200 len: 842 time: 0.1200671 Nov 11 17:06:15.528677 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-002ff938-856f-4b7c-a985-08a2f37c3b79 admin admin] Request body: {'subnet': {'cidr': '172.27.1.0/24', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'gateway_ip': '172.27.1.1', 'name': 'public-subnet', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:06:15.557638 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c8e73331-1ed4-4ae2-9730-43fe15ad66e8', 'name': 'router1', 'tenant_id': '4b30188d19194873aed7f02c87d439bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:06:00Z', 'updated_at': '2021-11-11T17:06:11Z', 'revision_number': 2, 'project_id': '4b30188d19194873aed7f02c87d439bb', 'gw_port_host': None, '_interfaces': [{'id': '60677f73-0028-4dbc-bfb7-3ea816ac814e', 'name': '', 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80', 'tenant_id': '4b30188d19194873aed7f02c87d439bb', 'mac_address': 'fa:16:3e:79:96:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c8e73331-1ed4-4ae2-9730-43fe15ad66e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '112c7908-febb-40e6-a757-429bad49c61e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:06:10Z', 'updated_at': '2021-11-11T17:06:14Z', 'revision_number': 4, 'project_id': '4b30188d19194873aed7f02c87d439bb', 'subnets': [{'id': '112c7908-febb-40e6-a757-429bad49c61e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5913535f-0924-4428-8c3d-4795619b56bc'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:06:15.562577 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b4f61428-61d8-4106-b766-ce99d00eab24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:15.583747 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8760dd6-188d-4dab-a5da-e38747db83e6 None None] The sync data for ids ['c8e73331-1ed4-4ae2-9730-43fe15ad66e8'] in dv-cinder-694140-2-iscsi is: [{'id': 'c8e73331-1ed4-4ae2-9730-43fe15ad66e8', 'name': 'router1', 'tenant_id': '4b30188d19194873aed7f02c87d439bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:06:00Z', 'updated_at': '2021-11-11T17:06:11Z', 'revision_number': 2, 'project_id': '4b30188d19194873aed7f02c87d439bb', 'gw_port_host': None, '_interfaces': [{'id': '60677f73-0028-4dbc-bfb7-3ea816ac814e', 'name': '', 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80', 'tenant_id': '4b30188d19194873aed7f02c87d439bb', 'mac_address': 'fa:16:3e:79:96:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c8e73331-1ed4-4ae2-9730-43fe15ad66e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '112c7908-febb-40e6-a757-429bad49c61e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:06:10Z', 'updated_at': '2021-11-11T17:06:14Z', 'revision_number': 4, 'project_id': '4b30188d19194873aed7f02c87d439bb', 'subnets': [{'id': '112c7908-febb-40e6-a757-429bad49c61e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5913535f-0924-4428-8c3d-4795619b56bc'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:06:15.596239 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-b4f61428-61d8-4106-b766-ce99d00eab24 None None] For port 60677f73-0028-4dbc-bfb7-3ea816ac814e, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=60677f73-0028-4dbc-bfb7-3ea816ac814e,segment=NetworkSegment(92e24367-cb3e-4c34-88f8-6fa5996e139c),segment_id=92e24367-cb3e-4c34-88f8-6fa5996e139c)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:06:15.616560 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-002ff938-856f-4b7c-a985-08a2f37c3b79 admin admin] Made reservation on behalf of a62f9c4d0b7f4443a8eb78e076640010 for: {'subnet': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:06:15.619194 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-002ff938-856f-4b7c-a985-08a2f37c3b79 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:15.662147 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b4f61428-61d8-4106-b766-ce99d00eab24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:15.722921 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4f61428-61d8-4106-b766-ce99d00eab24 None None] Pushing event updated for resources: {'Port': ['ID=60677f73-0028-4dbc-bfb7-3ea816ac814e,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:06:15.969175 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.objects.ports [None req-002ff938-856f-4b7c-a985-08a2f37c3b79 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102324) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 11 17:06:15.969526 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-002ff938-856f-4b7c-a985-08a2f37c3b79 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for subnet, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:16.031212 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-002ff938-856f-4b7c-a985-08a2f37c3b79 admin admin] Pushing event updated for resources: {'Subnet': ['ID=85627140-b558-482a-a384-b2095063cd88,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:06:16.033698 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-002ff938-856f-4b7c-a985-08a2f37c3b79 admin admin] Checking segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:06:16.034051 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-002ff938-856f-4b7c-a985-08a2f37c3b79 admin admin] Network hostable DHCP agents. Network: 78b17769-6fae-453e-8ae3-4a72e72bccfc, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:06:16.103196 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-002ff938-856f-4b7c-a985-08a2f37c3b79 admin admin] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:06:16.193512 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-002ff938-856f-4b7c-a985-08a2f37c3b79 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, 78b17769-6fae-453e-8ae3-4a72e72bccfc) {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:06:16.197480 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-002ff938-856f-4b7c-a985-08a2f37c3b79 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:06:16.198173 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-002ff938-856f-4b7c-a985-08a2f37c3b79 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:16.207645 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-971ec92a-c9bd-40f1-abaf-c8d6425f564b None None] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:06:16.307636 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-002ff938-856f-4b7c-a985-08a2f37c3b79 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7835059 Nov 11 17:06:16.355893 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7aee43d-fb85-46c1-a072-12e3c403f1c4 None None] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:06:19.293763 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 53882) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:06:19.523896 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-f91ed387-593b-47cc-bee4-1cfa1f72f37a admin admin] 10.222.0.16 "GET /v2.0/routers/c8e73331-1ed4-4ae2-9730-43fe15ad66e8 HTTP/1.1" status: 200 len: 710 time: 0.2283158 Nov 11 17:06:19.635016 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb374ef4-1e36-4718-9a20-245eae401bcc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:06:19.636839 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-fb374ef4-1e36-4718-9a20-245eae401bcc admin admin] 10.222.0.16 "GET /v2.0/networks/78b17769-6fae-453e-8ae3-4a72e72bccfc HTTP/1.1" status: 200 len: 886 time: 0.1046567 Nov 11 17:06:19.648208 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:06:20.032529 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:20.392238 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:20.482977 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:20.612733 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Allocated IP 172.27.1.76 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/4ede10ff-6a6b-428d-bcc5-dcf718703813) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:06:20.764996 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:20.869434 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:20.912700 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:06:20.918336 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:06:20.931192 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:06:20.933899 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Pushing event updated for resources: {'Port': ['ID=4ede10ff-6a6b-428d-bcc5-dcf718703813,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:06:21.417764 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:21.826043 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-397142', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-424508', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-7350'] for router, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:21.831936 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-397235', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-397121', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-397128', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-424487'] for router, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:22.009240 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Router c8e73331-1ed4-4ae2-9730-43fe15ad66e8 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:06:22.137242 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:06:22.141971 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] Publish callbacks [] for router, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:22.147398 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-895e7bd8-2e38-4c37-a9a2-f327b7454960 admin admin] 10.222.0.16 "PUT /v2.0/routers/c8e73331-1ed4-4ae2-9730-43fe15ad66e8 HTTP/1.1" status: 200 len: 889 time: 2.5028615 Nov 11 17:06:22.807128 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 60677f73-0028-4dbc-bfb7-3ea816ac814e up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:06:22.868015 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 60677f73-0028-4dbc-bfb7-3ea816ac814e triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:06:22.869079 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:23.607142 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Sync routers for ids ['c8e73331-1ed4-4ae2-9730-43fe15ad66e8'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:06:23.623619 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Routers {'c8e73331-1ed4-4ae2-9730-43fe15ad66e8'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:06:23.624304 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:06:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['c8e73331-1ed4-4ae2-9730-43fe15ad66e8'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:06:23.884849 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Set router c8e73331-1ed4-4ae2-9730-43fe15ad66e8 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:06:24.647545 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c8e73331-1ed4-4ae2-9730-43fe15ad66e8', 'name': 'router1', 'tenant_id': '4b30188d19194873aed7f02c87d439bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.76'}], 'enable_snat': True}, 'gw_port_id': '4ede10ff-6a6b-428d-bcc5-dcf718703813', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:06:00Z', 'updated_at': '2021-11-11T17:06:21Z', 'revision_number': 4, 'project_id': '4b30188d19194873aed7f02c87d439bb', 'gw_port': {'id': '4ede10ff-6a6b-428d-bcc5-dcf718703813', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:27:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c8e73331-1ed4-4ae2-9730-43fe15ad66e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:06:20Z', 'updated_at': '2021-11-11T17:06:20Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '60677f73-0028-4dbc-bfb7-3ea816ac814e', 'name': '', 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80', 'tenant_id': '4b30188d19194873aed7f02c87d439bb', 'mac_address': 'fa:16:3e:79:96:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c8e73331-1ed4-4ae2-9730-43fe15ad66e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '112c7908-febb-40e6-a757-429bad49c61e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:06:10Z', 'updated_at': '2021-11-11T17:06:15Z', 'revision_number': 5, 'project_id': '4b30188d19194873aed7f02c87d439bb', 'subnets': [{'id': '112c7908-febb-40e6-a757-429bad49c61e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5913535f-0924-4428-8c3d-4795619b56bc'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:06:24.706934 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Checking router: c8e73331-1ed4-4ae2-9730-43fe15ad66e8 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:06:24.707434 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Updating router c8e73331-1ed4-4ae2-9730-43fe15ad66e8 port 4ede10ff-6a6b-428d-bcc5-dcf718703813 binding host dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:06:24.766658 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:25.149040 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Publish callbacks [] for port, precommit_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:25.178392 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 53894) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:06:25.218164 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:25.312420 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Attempting to bind port 4ede10ff-6a6b-428d-bcc5-dcf718703813 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:06:25.312992 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Attempting to bind port 4ede10ff-6a6b-428d-bcc5-dcf718703813 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:06:25.313574 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Attempting to bind port 4ede10ff-6a6b-428d-bcc5-dcf718703813 on network 78b17769-6fae-453e-8ae3-4a72e72bccfc {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:06:25.316825 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6844316-650f-42b1-8dcb-bb100bf22a39 None None] Pushing event updated for resources: {'Port': ['ID=4ede10ff-6a6b-428d-bcc5-dcf718703813,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:06:25.320882 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-4689c692-0de1-4a63-a428-90636ff90683 admin admin] 10.222.0.16 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 410 time: 0.1406622 Nov 11 17:06:25.327793 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 6, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:06:25.328392 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Checking segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:06:25.329037 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:25.329669 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Bound using segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:06:25.330506 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Bound port: 4ede10ff-6a6b-428d-bcc5-dcf718703813, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:06:25.331205 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:25.428978 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] For port 4ede10ff-6a6b-428d-bcc5-dcf718703813, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:06:25.434494 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] For port 4ede10ff-6a6b-428d-bcc5-dcf718703813, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=4ede10ff-6a6b-428d-bcc5-dcf718703813,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:06:25.514696 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:25.617601 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6844316-650f-42b1-8dcb-bb100bf22a39 None None] Pushing event updated for resources: {'Port': ['ID=4ede10ff-6a6b-428d-bcc5-dcf718703813,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:06:25.622748 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Routers {'c8e73331-1ed4-4ae2-9730-43fe15ad66e8'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:06:25.623675 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:06:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['c8e73331-1ed4-4ae2-9730-43fe15ad66e8'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:06:25.789107 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] Set router c8e73331-1ed4-4ae2-9730-43fe15ad66e8 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:06:26.094938 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c8e73331-1ed4-4ae2-9730-43fe15ad66e8', 'name': 'router1', 'tenant_id': '4b30188d19194873aed7f02c87d439bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.76'}], 'enable_snat': True}, 'gw_port_id': '4ede10ff-6a6b-428d-bcc5-dcf718703813', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:06:00Z', 'updated_at': '2021-11-11T17:06:21Z', 'revision_number': 4, 'project_id': '4b30188d19194873aed7f02c87d439bb', 'gw_port': {'id': '4ede10ff-6a6b-428d-bcc5-dcf718703813', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:27:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c8e73331-1ed4-4ae2-9730-43fe15ad66e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:06:20Z', 'updated_at': '2021-11-11T17:06:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '60677f73-0028-4dbc-bfb7-3ea816ac814e', 'name': '', 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80', 'tenant_id': '4b30188d19194873aed7f02c87d439bb', 'mac_address': 'fa:16:3e:79:96:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c8e73331-1ed4-4ae2-9730-43fe15ad66e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '112c7908-febb-40e6-a757-429bad49c61e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:06:10Z', 'updated_at': '2021-11-11T17:06:15Z', 'revision_number': 5, 'project_id': '4b30188d19194873aed7f02c87d439bb', 'subnets': [{'id': '112c7908-febb-40e6-a757-429bad49c61e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5913535f-0924-4428-8c3d-4795619b56bc'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:06:26.141504 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2b58150-9e79-4f8a-a6c5-8494cbc837c3 None None] The sync data for ids ['c8e73331-1ed4-4ae2-9730-43fe15ad66e8'] in dv-cinder-694140-2-iscsi is: [{'id': 'c8e73331-1ed4-4ae2-9730-43fe15ad66e8', 'name': 'router1', 'tenant_id': '4b30188d19194873aed7f02c87d439bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.76'}], 'enable_snat': True}, 'gw_port_id': '4ede10ff-6a6b-428d-bcc5-dcf718703813', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:06:00Z', 'updated_at': '2021-11-11T17:06:21Z', 'revision_number': 4, 'project_id': '4b30188d19194873aed7f02c87d439bb', 'gw_port': {'id': '4ede10ff-6a6b-428d-bcc5-dcf718703813', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:27:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c8e73331-1ed4-4ae2-9730-43fe15ad66e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:06:20Z', 'updated_at': '2021-11-11T17:06:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '60677f73-0028-4dbc-bfb7-3ea816ac814e', 'name': '', 'network_id': '287eed58-093a-4d80-ac58-d3ed35cf1f80', 'tenant_id': '4b30188d19194873aed7f02c87d439bb', 'mac_address': 'fa:16:3e:79:96:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c8e73331-1ed4-4ae2-9730-43fe15ad66e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '112c7908-febb-40e6-a757-429bad49c61e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:06:10Z', 'updated_at': '2021-11-11T17:06:15Z', 'revision_number': 5, 'project_id': '4b30188d19194873aed7f02c87d439bb', 'subnets': [{'id': '112c7908-febb-40e6-a757-429bad49c61e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5913535f-0924-4428-8c3d-4795619b56bc'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:06:26.860858 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 4ede10ff-6a6b-428d-bcc5-dcf718703813 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:06:26.996068 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 4ede10ff-6a6b-428d-bcc5-dcf718703813 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:06:26.996445 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:27.156813 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:27.200753 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] For port 4ede10ff-6a6b-428d-bcc5-dcf718703813, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=4ede10ff-6a6b-428d-bcc5-dcf718703813,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:06:27.236734 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:27.305530 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Pushing event updated for resources: {'Port': ['ID=4ede10ff-6a6b-428d-bcc5-dcf718703813,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:06:28.821364 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 4ede10ff-6a6b-428d-bcc5-dcf718703813 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:06:28.898819 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 4ede10ff-6a6b-428d-bcc5-dcf718703813 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:06:28.901281 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:30.976574 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-5f27d288-ab5a-44c5-9157-16aa9e4f7750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:33.505584 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ec641e85-3daf-498f-8924-46760a639049 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:34.584113 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:36.254043 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:36.955209 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:06:38.155933 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 5 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:07:00.976866 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c0851582-ecbb-4a8d-ad97-687e31af2526 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:07:03.486403 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4babe0a6-f1eb-4a15-83cc-ad068b61cccc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:07:04.531599 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:07:06.217172 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:07:06.965374 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:07:15.152863 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 5 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:07:30.970169 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-9c7930de-7a1c-40d5-a9e5-f16023d92f6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:07:33.467299 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-9063114a-9df0-4f36-86b1-f215b1c94aa9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:07:34.558559 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:07:36.232915 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:07:36.986775 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:07:52.152920 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 5 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:08:00.957400 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-a52aeeb4-cd2e-4d18-bfd7-a7c1b51c1b95 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:08:03.481772 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-37d65209-f005-4749-8373-456857cece86 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:08:04.505748 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:08:06.231292 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:08:06.972817 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:08:14.019494 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 54456) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:08:14.096576 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.pecan_wsgi.hooks.translation [None req-33b30f83-cae8-40ab-8065-bfcdd5c9af1b admin admin] GET failed (client error): The resource could not be found. Nov 11 17:08:14.097908 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-33b30f83-cae8-40ab-8065-bfcdd5c9af1b admin admin] 10.222.0.16 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0774877 Nov 11 17:08:14.294721 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61aaf877-c998-485d-810e-76858876830a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:08:14.296124 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-61aaf877-c998-485d-810e-76858876830a admin admin] 10.222.0.16 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1935647 Nov 11 17:08:16.662933 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 54466) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:08:16.792350 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-808e34f8-c260-4fb7-80e0-5deba040b13d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:08:16.793748 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-808e34f8-c260-4fb7-80e0-5deba040b13d admin admin] 10.222.0.16 "GET /v2.0/subnets/112c7908-febb-40e6-a757-429bad49c61e HTTP/1.1" status: 200 len: 849 time: 0.1298769 Nov 11 17:08:16.804952 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:08:16.909763 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Publish callbacks [] for subnet, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:08:17.112124 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8735338510210'] for subnet, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:08:17.178744 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:08:17.179563 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:08:17.182696 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed753194-a84b-4767-9d5c-6debaa33d0d7 None None] Network 287eed58-093a-4d80-ac58-d3ed35cf1f80 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:08:17.183831 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] 10.222.0.16 "PUT /v2.0/subnets/112c7908-febb-40e6-a757-429bad49c61e HTTP/1.1" status: 200 len: 868 time: 0.3821251 Nov 11 17:08:17.204228 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Pushing event updated for resources: {'Subnet': ['ID=112c7908-febb-40e6-a757-429bad49c61e,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:08:17.214287 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:08:17.214846 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:08:17.214997 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:08:17.215328 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:08:17.215659 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:08:17.215993 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:08:17.216378 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:08:17.216725 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:08:17.217084 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:08:17.217457 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:08:17.217788 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:08:17.218109 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51e9b58b-2897-4d38-ba4f-8743e9c1ae01 admin admin] Tracked resource versions report: Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: pushed versions: Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: { 'AddressGroup': {'1.2'}, Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'ConntrackHelper': {'1.0'}, Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Log': {'1.0'}, Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Network': {'1.1'}, Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Port': {'1.7'}, Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'PortForwarding': {'1.2'}, Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'QosPolicy': {'1.10'}, Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'SecurityGroup': {'1.5'}, Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'SecurityGroupRule': {'1.2'}, Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'SubPort': {'1.0'}, Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Subnet': {'1.1'}, Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Trunk': {'1.1'}} Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: consumer versions: Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: { DHCP agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: L3 agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: Metadata agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: Metering agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: Open vSwitch agent@dv-cinder-694140-2-iscsi: { 'AddressGroup': '1.2', Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'ConntrackHelper': '1.0', Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Log': '1.0', Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Network': '1.1', Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Port': '1.7', Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'PortForwarding': '1.2', Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'QosPolicy': '1.10', Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'SecurityGroup': '1.5', Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'SecurityGroupRule': '1.2', Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'SubPort': '1.0', Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Subnet': '1.1', Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Trunk': '1.1'}} Nov 11 17:08:17.219263 dv-cinder-694140-2-iscsi neutron-server[102323]: {{(pid=102323) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 11 17:08:17.606221 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-88014660-f1ae-4ce0-a50a-a4a0951babb1 None None] Provisioning complete for port b23dc5e5-826c-4c0c-baef-547609ced676 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:08:17.606644 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-88014660-f1ae-4ce0-a50a-a4a0951babb1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:08:17.698683 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-88014660-f1ae-4ce0-a50a-a4a0951babb1 None None] Provisioning complete for port 60677f73-0028-4dbc-bfb7-3ea816ac814e triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:08:17.698941 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-88014660-f1ae-4ce0-a50a-a4a0951babb1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:08:19.511042 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 54478) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:08:19.719195 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-747ea6e7-5b58-490b-a7c2-537c59a02e00 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:08:19.719583 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-747ea6e7-5b58-490b-a7c2-537c59a02e00 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:08:19.721174 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-747ea6e7-5b58-490b-a7c2-537c59a02e00 admin admin] 10.222.0.16 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2091694 Nov 11 17:08:22.103681 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54486) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:08:22.304831 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed434b5e-d31d-49b8-830c-629c3df8895f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:08:22.305213 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed434b5e-d31d-49b8-830c-629c3df8895f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:08:22.306914 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-ed434b5e-d31d-49b8-830c-629c3df8895f admin admin] 10.222.0.16 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2021337 Nov 11 17:08:24.660890 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54496) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:08:24.793850 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f33a9850-4f44-49a5-a23f-a39036d7299e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:08:24.795256 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-f33a9850-4f44-49a5-a23f-a39036d7299e admin admin] 10.222.0.16 "GET /v2.0/networks/287eed58-093a-4d80-ac58-d3ed35cf1f80 HTTP/1.1" status: 200 len: 869 time: 0.1319678 Nov 11 17:08:27.132025 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54504) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:08:27.265336 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2bbf8941-0917-44a3-a89b-b99177e2ddda admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:08:27.266803 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-2bbf8941-0917-44a3-a89b-b99177e2ddda admin admin] 10.222.0.16 "GET /v2.0/networks/78b17769-6fae-453e-8ae3-4a72e72bccfc HTTP/1.1" status: 200 len: 886 time: 0.1336989 Nov 11 17:08:29.151237 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 5 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:08:29.646943 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54512) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:08:29.809049 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0f9aa86-6928-4ef6-897a-795bb472e7ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:08:29.809493 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0f9aa86-6928-4ef6-897a-795bb472e7ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:08:29.811072 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-d0f9aa86-6928-4ef6-897a-795bb472e7ff admin admin] 10.222.0.16 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1631572 Nov 11 17:08:30.956288 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-d5894dfc-1d08-44ba-98fa-546632055a25 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:08:32.160751 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54520) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:08:32.251770 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-829e617b-f170-4c27-85b1-4e7ee69e2cfa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:08:32.252219 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-829e617b-f170-4c27-85b1-4e7ee69e2cfa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:08:32.253773 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-829e617b-f170-4c27-85b1-4e7ee69e2cfa admin admin] 10.222.0.16 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0920305 Nov 11 17:08:33.470961 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3af12401-23d5-446d-807b-94520de3a1b9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:08:34.555893 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:08:34.603671 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54528) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:08:34.699196 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9fb0ba7-ae3a-49a0-9000-6a507a0eac32 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:08:34.700571 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-f9fb0ba7-ae3a-49a0-9000-6a507a0eac32 admin admin] 10.222.0.16 "GET /v2.0/subnets/112c7908-febb-40e6-a757-429bad49c61e HTTP/1.1" status: 200 len: 868 time: 0.0959518 Nov 11 17:08:36.241154 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:08:36.989781 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:08:37.048366 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54536) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:08:37.134807 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4890574-bd6a-4813-a2aa-f339bec8ae8d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:08:37.136169 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-b4890574-bd6a-4813-a2aa-f339bec8ae8d admin admin] 10.222.0.16 "GET /v2.0/subnets/85627140-b558-482a-a384-b2095063cd88 HTTP/1.1" status: 200 len: 816 time: 0.0869477 Nov 11 17:09:00.960220 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-e8ee3845-9a65-4943-a34e-5599b02b91cf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:02.772988 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54590) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:09:02.820332 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [None req-1de3c853-e9fb-47b7-ac18-4deed47c0808 admin admin] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=102324) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 17:09:02.821354 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-1de3c853-e9fb-47b7-ac18-4deed47c0808 admin admin] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0474300 Nov 11 17:09:03.469843 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-2d77ccae-d8b5-4580-999d-35784300f043 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:04.541450 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:05.290277 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54598) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:09:05.350822 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.pecan_wsgi.hooks.translation [None req-d21b2bdd-56fa-4474-8c00-e73dcdcec82b admin admin] GET failed (client error): The resource could not be found. Nov 11 17:09:05.352165 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-d21b2bdd-56fa-4474-8c00-e73dcdcec82b admin admin] 10.222.0.16 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0609145 Nov 11 17:09:05.495755 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-080841a2-02b3-417f-b141-b016c94000b4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:09:05.497150 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-080841a2-02b3-417f-b141-b016c94000b4 admin admin] 10.222.0.16 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1400197 Nov 11 17:09:06.150482 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 5 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:09:06.245558 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:06.993660 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:07.901185 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54606) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:09:07.948243 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Request body: {'network': {'shared': True, 'admin_state_up': True, 'name': 'shared'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:09:08.028034 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Made reservation on behalf of a62f9c4d0b7f4443a8eb78e076640010 for: {'network': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:09:08.030341 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:08.060089 dv-cinder-694140-2-iscsi neutron-server[102324]: WARNING neutron.services.revisions.revision_plugin [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Could not find related network for resource to bump revision. Nov 11 17:09:08.071124 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] vlan segment allocate from pool success with {'vlan_id': 526, 'physical_network': 'physnet1'} {{(pid=102324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:09:08.079714 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:08.079980 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.segments_db [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Added segment 6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf of type vlan for network 5cc951aa-501f-4b44-a0ad-11046541b62a Nov 11 17:09:08.118768 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:08.216542 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:08.217585 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:09:08.218186 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:08.275743 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Pushing event updated for resources: {'Network': ['ID=5cc951aa-501f-4b44-a0ad-11046541b62a,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:09:08.282274 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:08.282659 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:08.282988 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:08.283340 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:08.283668 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:08.284072 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:08.284349 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:08.284690 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:08.285035 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:08.285376 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:08.285697 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:08.286014 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:08.297327 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network 5cc951aa-501f-4b44-a0ad-11046541b62a details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:09:08.300435 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-29c4a7b9-1ba5-4a52-aef3-0c3a6821d84f admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.3981476 Nov 11 17:09:10.682456 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54614) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:09:10.745450 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.pecan_wsgi.hooks.translation [None req-c3df897a-7be3-4065-b6a7-7ea838e2df0d admin admin] GET failed (client error): The resource could not be found. Nov 11 17:09:10.746971 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-c3df897a-7be3-4065-b6a7-7ea838e2df0d admin admin] 10.222.0.16 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0633826 Nov 11 17:09:10.957811 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34253150-b779-4805-a791-b619e99c7744 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:09:10.959226 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-34253150-b779-4805-a791-b619e99c7744 admin admin] 10.222.0.16 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.2054486 Nov 11 17:09:10.971044 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-05e80eae-7489-46bb-a4ed-d45fb94c62e5 admin admin] Request body: {'subnet': {'ip_version': 4, 'cidr': '192.168.233.0/24', 'description': 'shared-subnet', 'network_id': '5cc951aa-501f-4b44-a0ad-11046541b62a', 'name': 'shared-subnet'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:09:11.108322 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-05e80eae-7489-46bb-a4ed-d45fb94c62e5 admin admin] Made reservation on behalf of a62f9c4d0b7f4443a8eb78e076640010 for: {'subnet': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:09:11.111094 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-05e80eae-7489-46bb-a4ed-d45fb94c62e5 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:11.461319 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-05e80eae-7489-46bb-a4ed-d45fb94c62e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for subnet, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:11.519450 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05e80eae-7489-46bb-a4ed-d45fb94c62e5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b1116129-689a-47aa-b946-b2cf91d8a485,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:09:11.533609 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05e80eae-7489-46bb-a4ed-d45fb94c62e5 admin admin] Checking segment: {'id': '6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '5cc951aa-501f-4b44-a0ad-11046541b62a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:09:11.534011 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05e80eae-7489-46bb-a4ed-d45fb94c62e5 admin admin] Network hostable DHCP agents. Network: 5cc951aa-501f-4b44-a0ad-11046541b62a, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:09:11.622055 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05e80eae-7489-46bb-a4ed-d45fb94c62e5 admin admin] Network 5cc951aa-501f-4b44-a0ad-11046541b62a is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:09:11.696498 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-05e80eae-7489-46bb-a4ed-d45fb94c62e5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, 5cc951aa-501f-4b44-a0ad-11046541b62a) {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:09:11.701107 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05e80eae-7489-46bb-a4ed-d45fb94c62e5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:09:11.701695 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-05e80eae-7489-46bb-a4ed-d45fb94c62e5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:11.709556 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4680039a-7b34-44c7-8d97-8fce10c609e5 None None] Network 5cc951aa-501f-4b44-a0ad-11046541b62a requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:09:11.768184 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-05e80eae-7489-46bb-a4ed-d45fb94c62e5 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.8014407 Nov 11 17:09:11.869304 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaac6311d-333a-5f5f-a33c-91960009c34a-5cc951aa-501f-4b44-a0ad-11046541b62a', 'network_id': '5cc951aa-501f-4b44-a0ad-11046541b62a', 'tenant_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'fixed_ips': [{'subnet_id': 'b1116129-689a-47aa-b946-b2cf91d8a485'}]}} from dv-cinder-694140-2-iscsi. {{(pid=102325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 17:09:11.870400 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:12.049237 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.db_base_plugin_common [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Allocated IP 192.168.233.2 (5cc951aa-501f-4b44-a0ad-11046541b62a/b1116129-689a-47aa-b946-b2cf91d8a485/b2a7d7f6-4d91-467d-b3c0-3a9624607630) {{(pid=102325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:09:12.263628 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Publish callbacks [] for port, precommit_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:12.348618 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624'] for port, after_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:12.422622 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Network 5cc951aa-501f-4b44-a0ad-11046541b62a is already hosted by enough agents. {{(pid=102325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:09:12.427612 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.base_scheduler [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Resources bound (agent type, host, resource id): {{(pid=102325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:09:12.434537 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Received port after_create {{(pid=102325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:09:12.444942 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Pushing event updated for resources: {'Port': ['ID=b2a7d7f6-4d91-467d-b3c0-3a9624607630,revision_number=1']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:09:12.457982 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:12.458374 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:12.458726 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:12.459068 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:12.459399 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:12.459730 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:12.460056 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:12.466012 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:12.466012 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:12.466012 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:12.466012 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:12.466012 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:09:12.517464 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Attempting to bind port b2a7d7f6-4d91-467d-b3c0-3a9624607630 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:09:12.517845 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Attempting to bind port b2a7d7f6-4d91-467d-b3c0-3a9624607630 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '5cc951aa-501f-4b44-a0ad-11046541b62a'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:09:12.518213 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Attempting to bind port b2a7d7f6-4d91-467d-b3c0-3a9624607630 on network 5cc951aa-501f-4b44-a0ad-11046541b62a {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:09:12.525483 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 9, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:09:12.526123 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Checking segment: {'id': '6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '5cc951aa-501f-4b44-a0ad-11046541b62a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:09:12.527066 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:12.527682 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Bound using segment: {'id': '6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '5cc951aa-501f-4b44-a0ad-11046541b62a'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:09:12.528399 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Bound port: b2a7d7f6-4d91-467d-b3c0-3a9624607630, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '5cc951aa-501f-4b44-a0ad-11046541b62a'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:09:12.528945 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:12.621351 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] For port b2a7d7f6-4d91-467d-b3c0-3a9624607630, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:09:12.627518 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] For port b2a7d7f6-4d91-467d-b3c0-3a9624607630, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=b2a7d7f6-4d91-467d-b3c0-3a9624607630,segment=NetworkSegment(6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf),segment_id=6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:09:12.715041 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:12.807329 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd0d8067-3de7-4bd2-a0cf-5897261bcd69 None None] Pushing event updated for resources: {'Port': ['ID=b2a7d7f6-4d91-467d-b3c0-3a9624607630,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:09:13.760997 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16ed4837-7692-4713-9dc3-95b5edc631bb None None] Network 5cc951aa-501f-4b44-a0ad-11046541b62a requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:09:13.890669 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-83937ba0-ca04-4a2e-af8b-a9f7b6d56b4d None None] Provisioning complete for port b2a7d7f6-4d91-467d-b3c0-3a9624607630 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:09:13.891038 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-83937ba0-ca04-4a2e-af8b-a9f7b6d56b4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:14.062374 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-83937ba0-ca04-4a2e-af8b-a9f7b6d56b4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:14.121518 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-83937ba0-ca04-4a2e-af8b-a9f7b6d56b4d None None] For port b2a7d7f6-4d91-467d-b3c0-3a9624607630, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=b2a7d7f6-4d91-467d-b3c0-3a9624607630,segment=NetworkSegment(6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf),segment_id=6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:09:14.216440 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-83937ba0-ca04-4a2e-af8b-a9f7b6d56b4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:14.284405 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83937ba0-ca04-4a2e-af8b-a9f7b6d56b4d None None] Pushing event updated for resources: {'Port': ['ID=b2a7d7f6-4d91-467d-b3c0-3a9624607630,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:09:14.338520 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-39d5f9f2-5fdc-4685-ba1f-7ec48e4aea21 None None] Provisioning complete for port b2a7d7f6-4d91-467d-b3c0-3a9624607630 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:09:14.338958 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-39d5f9f2-5fdc-4685-ba1f-7ec48e4aea21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:14.918708 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device b2a7d7f6-4d91-467d-b3c0-3a9624607630 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:09:14.981920 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port b2a7d7f6-4d91-467d-b3c0-3a9624607630 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:09:14.982286 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:30.986806 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-07dcbe68-052f-4348-abc6-3bf7d0b610d1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:33.487973 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-0b993b66-2359-4c78-b7f4-456dcc293f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:34.534936 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:36.272213 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:37.001912 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:09:43.148876 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 5 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:10:00.956260 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-6300f82a-3ba0-410a-9c9d-214197ad47aa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:03.509912 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-08be9494-53eb-4de2-b5b0-eb97dbf73927 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:04.532553 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:06.281111 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:06.982596 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:20.150578 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 5 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:10:30.953953 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-36155360-b263-4e31-9c16-3aaddb6f56a5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:33.479220 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-46fd40ab-5af7-4ee8-bb6f-da87c94b1959 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:34.547769 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:36.245043 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:36.284433 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54658) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:10:36.290272 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [None req-5facf8c6-f7de-4a80-a09b-96bc4ac57d95 tempest-verify_tempest_config-190065786 tempest-verify_tempest_config-190065786-project] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=102324) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 17:10:36.291268 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-5facf8c6-f7de-4a80-a09b-96bc4ac57d95 tempest-verify_tempest_config-190065786 tempest-verify_tempest_config-190065786-project] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0059063 Nov 11 17:10:36.834675 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 54676) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:10:36.947046 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:37.046565 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:37.078951 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:37.135903 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:37.191091 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=2a186b82f0c54ad28a4180830dee0d73&name=default HTTP/1.1" status: 200 len: 2992 time: 0.3553281 Nov 11 17:10:37.192119 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f72ea337-f2e1-42cc-b26e-7d07d1e84078,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:10:37.193907 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54682) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:10:37.199694 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.200083 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.200434 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.200868 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.201202 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.201539 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.201872 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.202203 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.202576 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.202947 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.203276 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.203598 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f542128b-13ab-4599-a8a5-6af12d0f4ac4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.250104 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:37.270374 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:37.451666 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:37.454506 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:10:37.455887 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/f72ea337-f2e1-42cc-b26e-7d07d1e84078 HTTP/1.1" status: 204 len: 168 time: 0.2609503 Nov 11 17:10:37.464224 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f72ea337-f2e1-42cc-b26e-7d07d1e84078,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:10:37.471568 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.471958 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.472362 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.472696 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.473025 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.473366 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.473693 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.474038 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.474382 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.474731 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.475047 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:37.475615 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-848c31d4-9947-4878-a466-ebf9cdd7e974 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:10:57.149312 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 5 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:11:00.974620 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-d18efadd-a015-41a5-abaf-bba5b00f657e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:11:03.494243 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-882bc61e-e945-4ade-8ca1-215e04d53833 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:11:04.551359 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:11:06.282295 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:11:06.979376 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:11:30.935125 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-845e126d-816a-489c-b66b-1995d48d8a89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:11:33.484145 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-213be165-d622-433e-ae44-4bc8f664fbd6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:11:34.147490 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 5 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:11:34.558598 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:11:36.287909 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:11:36.963787 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:12:00.954530 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-f0f07e78-cd0e-4605-b2d7-b2a27126dae7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:12:03.485046 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-45cce9eb-f0e0-4e70-9c96-58d87684739a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:12:04.542959 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:12:06.330970 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:12:06.971297 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:12:11.147110 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 5 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:12:16.154110 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-393800'] for agent, after_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:12:30.943664 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-61e0bf72-a87b-442f-9b07-3e264fd94092 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:12:31.422187 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54754) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:12:31.526413 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-dbaa7f6e-6eed-48fd-b695-02c1bb3e8a51 admin admin] 10.222.0.16 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1031840 Nov 11 17:12:33.490915 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-f9062a75-8d94-4325-ba5d-831f7031c9f2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:12:33.868997 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54764) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:12:33.923121 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-02832a84-fd4f-47ec-bd0d-6d965326a2fd admin admin] 10.222.0.16 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0530488 Nov 11 17:12:34.549221 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:12:36.268860 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:12:36.983357 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:12:46.098013 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:12:48.146470 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:13:00.961015 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-264103f4-c144-4d59-8570-0a992245ad3b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:13:03.498195 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-37b162c8-8db5-4fce-8891-c05f81276e31 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:13:04.567026 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:13:06.275642 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:13:06.995727 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:13:16.110037 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:13:25.145426 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:13:30.973427 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-cf0f7a5f-1c20-43bb-9b43-f2b1eece0973 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:13:33.487718 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4e9a0f52-013a-4f19-bdf3-d2a9e210ff2f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:13:34.567651 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:13:36.326584 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:13:36.973296 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:13:46.115932 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:00.944563 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-a7728a25-95ee-477a-8ce2-9d3269957635 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:02.144088 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:14:03.476359 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-d4918f60-b874-4a72-a543-b122ce78bf30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:04.601085 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:06.304813 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:06.985548 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:07.459488 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54964) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:07.679840 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 54974) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:07.990050 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1671063588-network', 'tenant_id': 'cceb60931e5541518c468df87510c262'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:08.124395 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Made reservation on behalf of cceb60931e5541518c468df87510c262 for: {'network': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:14:08.126772 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.136134 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.208771 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 54990) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:08.247143 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.255266 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-bf64b1f8-a6db-4570-86e6-f5a091854181 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1564327028-network', 'tenant_id': '34577e94e3cb42d6b73cd1f88c6f8b80'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:08.346291 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55002) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:08.386746 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-517002489-network', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:08.407496 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.421841 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] vlan segment allocate from pool success with {'vlan_id': 532, 'physical_network': 'physnet1'} {{(pid=102324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:14:08.444593 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=90913116-0d08-4375-aa52-9d7cd00f37d2,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:08.448049 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bf64b1f8-a6db-4570-86e6-f5a091854181 admin admin] Made reservation on behalf of 34577e94e3cb42d6b73cd1f88c6f8b80 for: {'network': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:14:08.450281 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bf64b1f8-a6db-4570-86e6-f5a091854181 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.465174 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.465872 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.466053 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.466375 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.466723 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.467068 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.467392 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.467716 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.468043 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.468360 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.468674 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.468980 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Tracked resource versions report: Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: pushed versions: Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: { 'AddressGroup': {'1.2'}, Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'ConntrackHelper': {'1.0'}, Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Log': {'1.0'}, Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Network': {'1.1'}, Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Port': {'1.7'}, Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'PortForwarding': {'1.2'}, Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'QosPolicy': {'1.10'}, Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'SecurityGroup': {'1.5'}, Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'SecurityGroupRule': {'1.2'}, Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'SubPort': {'1.0'}, Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Subnet': {'1.1'}, Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Trunk': {'1.1'}} Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: consumer versions: Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: { DHCP agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: HyperV agent@hv-cinder-69414: {}, Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: L3 agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: Metadata agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: Metering agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: Open vSwitch agent@dv-cinder-694140-2-iscsi: { 'AddressGroup': '1.2', Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'ConntrackHelper': '1.0', Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Log': '1.0', Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Network': '1.1', Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Port': '1.7', Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'PortForwarding': '1.2', Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'QosPolicy': '1.10', Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'SecurityGroup': '1.5', Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'SecurityGroupRule': '1.2', Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'SubPort': '1.0', Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Subnet': '1.1', Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: 'Trunk': '1.1'}} Nov 11 17:14:08.470124 dv-cinder-694140-2-iscsi neutron-server[102324]: {{(pid=102324) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 11 17:14:08.474821 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.475160 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.segments_db [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Added segment 0a2ff661-8b92-4963-a90f-415ffdc06b18 of type vlan for network dee85f4f-de83-4218-8f3b-9f48a95689a9 Nov 11 17:14:08.485847 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bf64b1f8-a6db-4570-86e6-f5a091854181 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.532576 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.573411 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Made reservation on behalf of 3a6e5bdc578b460ab28a883efa598f95 for: {'network': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:14:08.575941 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.584806 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.632560 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bf64b1f8-a6db-4570-86e6-f5a091854181 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.645869 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-a1648b90-f0fe-4c64-964f-4504a115250e admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-797046329-network', 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:08.659018 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.659982 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:08.660580 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.704475 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.718158 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] Pushing event updated for resources: {'Network': ['ID=dee85f4f-de83-4218-8f3b-9f48a95689a9,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:08.728666 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network dee85f4f-de83-4218-8f3b-9f48a95689a9 details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:14:08.741716 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bf64b1f8-a6db-4570-86e6-f5a091854181 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.769643 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bf64b1f8-a6db-4570-86e6-f5a091854181 admin admin] vlan segment allocate from pool success with {'vlan_id': 545, 'physical_network': 'physnet1'} {{(pid=102324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:14:08.780078 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf64b1f8-a6db-4570-86e6-f5a091854181 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=651d5e8b-43c3-4632-9731-13c745d1f8cb,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:08.785684 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bf64b1f8-a6db-4570-86e6-f5a091854181 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.785922 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.segments_db [None req-bf64b1f8-a6db-4570-86e6-f5a091854181 admin admin] Added segment 08a339d2-f0ca-49a4-b7a6-31aa65d05381 of type vlan for network a98ace73-2226-4e0a-a94f-8a41b5a9a68e Nov 11 17:14:08.803071 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a1648b90-f0fe-4c64-964f-4504a115250e admin admin] Made reservation on behalf of ed26d137d98846b9b45708f7e581e9b0 for: {'network': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:14:08.809813 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a1648b90-f0fe-4c64-964f-4504a115250e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.826092 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a1648b90-f0fe-4c64-964f-4504a115250e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.832487 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bf64b1f8-a6db-4570-86e6-f5a091854181 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.920234 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a1648b90-f0fe-4c64-964f-4504a115250e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.921930 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.945354 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bf64b1f8-a6db-4570-86e6-f5a091854181 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.947761 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf64b1f8-a6db-4570-86e6-f5a091854181 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:08.952849 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bf64b1f8-a6db-4570-86e6-f5a091854181 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:08.955218 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=96bc1adc-db69-46ac-b26d-3dc384499944,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:08.964728 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.965096 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.965442 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.965778 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.966165 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.966600 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.966943 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.967289 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.967635 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.967959 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.968284 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.968604 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Tracked resource versions report: Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: pushed versions: Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: { 'AddressGroup': {'1.2'}, Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'ConntrackHelper': {'1.0'}, Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Log': {'1.0'}, Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Network': {'1.1'}, Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Port': {'1.7'}, Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'PortForwarding': {'1.2'}, Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'QosPolicy': {'1.10'}, Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'SecurityGroup': {'1.5'}, Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'SecurityGroupRule': {'1.2'}, Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'SubPort': {'1.0'}, Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Subnet': {'1.1'}, Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Trunk': {'1.1'}} Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: consumer versions: Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: { DHCP agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: HyperV agent@hv-cinder-69414: {}, Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: L3 agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: Metadata agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: Metering agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: Open vSwitch agent@dv-cinder-694140-2-iscsi: { 'AddressGroup': '1.2', Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'ConntrackHelper': '1.0', Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Log': '1.0', Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Network': '1.1', Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Port': '1.7', Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'PortForwarding': '1.2', Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'QosPolicy': '1.10', Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'SecurityGroup': '1.5', Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'SecurityGroupRule': '1.2', Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'SubPort': '1.0', Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Subnet': '1.1', Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: 'Trunk': '1.1'}} Nov 11 17:14:08.969634 dv-cinder-694140-2-iscsi neutron-server[102323]: {{(pid=102323) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 11 17:14:08.997479 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] vlan segment allocate from pool success with {'vlan_id': 538, 'physical_network': 'physnet1'} {{(pid=102323) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:14:08.999275 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-e08cc9ef-932a-4942-b9ac-33d2e52687b9 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.5383632 Nov 11 17:14:09.000438 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55026) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:09.009512 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-33b50f6a-3c38-474d-ad2a-cc1a21c3b00b admin admin] Request body: {'subnet': {'network_id': 'dee85f4f-de83-4218-8f3b-9f48a95689a9', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1671063588-subnet', 'tenant_id': 'cceb60931e5541518c468df87510c262', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:09.017392 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a1648b90-f0fe-4c64-964f-4504a115250e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:09.048310 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf64b1f8-a6db-4570-86e6-f5a091854181 admin admin] Pushing event updated for resources: {'Network': ['ID=a98ace73-2226-4e0a-a94f-8a41b5a9a68e,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:09.048548 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8735338596316', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:09.049108 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Unsubscribe: segment precommit_create {{(pid=102323) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 11 17:14:09.049605 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.segments_db [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Added segment 47be9a7f-0eae-411b-a3de-e2c448d6c842 of type vlan for network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f Nov 11 17:14:09.062093 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network a98ace73-2226-4e0a-a94f-8a41b5a9a68e details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:14:09.084363 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1648b90-f0fe-4c64-964f-4504a115250e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:09.087133 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a1648b90-f0fe-4c64-964f-4504a115250e admin admin] vlan segment allocate from pool success with {'vlan_id': 537, 'physical_network': 'physnet1'} {{(pid=102323) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:14:09.139197 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-bf64b1f8-a6db-4570-86e6-f5a091854181 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.4574902 Nov 11 17:14:09.146486 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55036) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:09.146486 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-30a3c5ed-92c8-44d9-83cd-3af4023fd8c4 admin admin] Request body: {'subnet': {'network_id': 'a98ace73-2226-4e0a-a94f-8a41b5a9a68e', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1564327028-subnet', 'tenant_id': '34577e94e3cb42d6b73cd1f88c6f8b80', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:09.162889 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a1648b90-f0fe-4c64-964f-4504a115250e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:09.163451 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.segments_db [None req-a1648b90-f0fe-4c64-964f-4504a115250e admin admin] Added segment 5eacaa77-ea76-482f-aec2-5adad8f8bde5 of type vlan for network 983bda4c-112d-442d-b37a-387818bb1d45 Nov 11 17:14:09.180115 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:09.245235 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a1648b90-f0fe-4c64-964f-4504a115250e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:09.260356 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-33b50f6a-3c38-474d-ad2a-cc1a21c3b00b admin admin] Made reservation on behalf of cceb60931e5541518c468df87510c262 for: {'subnet': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:14:09.263761 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-33b50f6a-3c38-474d-ad2a-cc1a21c3b00b admin admin] Publish callbacks [] for subnet, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:09.319231 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:09.321238 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:09.321386 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:09.398443 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-30a3c5ed-92c8-44d9-83cd-3af4023fd8c4 admin admin] Made reservation on behalf of 34577e94e3cb42d6b73cd1f88c6f8b80 for: {'subnet': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:14:09.398443 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-30a3c5ed-92c8-44d9-83cd-3af4023fd8c4 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:09.460088 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] Pushing event updated for resources: {'Network': ['ID=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:09.473892 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a1648b90-f0fe-4c64-964f-4504a115250e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:09.475116 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1648b90-f0fe-4c64-964f-4504a115250e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:09.475652 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a1648b90-f0fe-4c64-964f-4504a115250e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:09.481611 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:14:09.575408 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-407065de-1dd0-497e-90f5-7cff02ac0510 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 1.3652997 Nov 11 17:14:09.577420 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55052) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:09.586753 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-a8fed662-4321-47a7-a022-2778b3ad8bb5 admin admin] Request body: {'subnet': {'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-subnet', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:09.634729 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-a1648b90-f0fe-4c64-964f-4504a115250e admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 1.2843378 Nov 11 17:14:09.635471 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55056) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:09.640394 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-58c27925-4ed4-419a-bc63-b1ad93a795cf admin admin] Request body: {'subnet': {'network_id': '983bda4c-112d-442d-b37a-387818bb1d45', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-797046329-subnet', 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:09.646780 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1648b90-f0fe-4c64-964f-4504a115250e admin admin] Pushing event updated for resources: {'Network': ['ID=983bda4c-112d-442d-b37a-387818bb1d45,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:09.658884 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network 983bda4c-112d-442d-b37a-387818bb1d45 details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:14:09.711024 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-30a3c5ed-92c8-44d9-83cd-3af4023fd8c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for subnet, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:09.755838 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a8fed662-4321-47a7-a022-2778b3ad8bb5 admin admin] Made reservation on behalf of 3a6e5bdc578b460ab28a883efa598f95 for: {'subnet': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:14:09.759072 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a8fed662-4321-47a7-a022-2778b3ad8bb5 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:09.763460 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a3c5ed-92c8-44d9-83cd-3af4023fd8c4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1db18803-fca7-4dcd-9806-8936b94cf1b1,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:09.801874 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30a3c5ed-92c8-44d9-83cd-3af4023fd8c4 admin admin] Checking segment: {'id': '08a339d2-f0ca-49a4-b7a6-31aa65d05381', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': 'a98ace73-2226-4e0a-a94f-8a41b5a9a68e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:14:09.802261 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30a3c5ed-92c8-44d9-83cd-3af4023fd8c4 admin admin] Network hostable DHCP agents. Network: a98ace73-2226-4e0a-a94f-8a41b5a9a68e, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:14:09.917055 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-58c27925-4ed4-419a-bc63-b1ad93a795cf admin admin] Made reservation on behalf of ed26d137d98846b9b45708f7e581e9b0 for: {'subnet': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:14:09.919621 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-58c27925-4ed4-419a-bc63-b1ad93a795cf admin admin] Publish callbacks [] for subnet, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:09.923254 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30a3c5ed-92c8-44d9-83cd-3af4023fd8c4 admin admin] Network a98ace73-2226-4e0a-a94f-8a41b5a9a68e is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:14:09.928056 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-33b50f6a-3c38-474d-ad2a-cc1a21c3b00b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for subnet, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:09.996995 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33b50f6a-3c38-474d-ad2a-cc1a21c3b00b admin admin] Pushing event updated for resources: {'Subnet': ['ID=e608e66c-e895-4298-9bef-647d1d33f98e,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:10.034251 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33b50f6a-3c38-474d-ad2a-cc1a21c3b00b admin admin] Checking segment: {'id': '0a2ff661-8b92-4963-a90f-415ffdc06b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 532, 'network_id': 'dee85f4f-de83-4218-8f3b-9f48a95689a9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:14:10.035145 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33b50f6a-3c38-474d-ad2a-cc1a21c3b00b admin admin] Network hostable DHCP agents. Network: dee85f4f-de83-4218-8f3b-9f48a95689a9, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102323) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:14:10.063029 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-30a3c5ed-92c8-44d9-83cd-3af4023fd8c4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, a98ace73-2226-4e0a-a94f-8a41b5a9a68e) {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:10.069538 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30a3c5ed-92c8-44d9-83cd-3af4023fd8c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:10.070132 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-30a3c5ed-92c8-44d9-83cd-3af4023fd8c4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:10.071842 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c20e7e1-80e5-4224-a76e-8bdedae47f03 None None] Network a98ace73-2226-4e0a-a94f-8a41b5a9a68e requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:14:10.083459 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a8fed662-4321-47a7-a022-2778b3ad8bb5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for subnet, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:10.147774 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8fed662-4321-47a7-a022-2778b3ad8bb5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1a4b11d7-2160-49c3-be78-265f0700c580,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:10.172546 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8fed662-4321-47a7-a022-2778b3ad8bb5 admin admin] Checking segment: {'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:14:10.172932 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8fed662-4321-47a7-a022-2778b3ad8bb5 admin admin] Network hostable DHCP agents. Network: 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102323) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:14:10.179191 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33b50f6a-3c38-474d-ad2a-cc1a21c3b00b admin admin] Network dee85f4f-de83-4218-8f3b-9f48a95689a9 is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102323) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:14:10.193704 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-33b50f6a-3c38-474d-ad2a-cc1a21c3b00b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, dee85f4f-de83-4218-8f3b-9f48a95689a9) {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:10.200875 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33b50f6a-3c38-474d-ad2a-cc1a21c3b00b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:10.201477 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-33b50f6a-3c38-474d-ad2a-cc1a21c3b00b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:10.236270 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-30a3c5ed-92c8-44d9-83cd-3af4023fd8c4 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.0848660 Nov 11 17:14:10.236270 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-58c27925-4ed4-419a-bc63-b1ad93a795cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for subnet, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:10.252676 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-79482c40-ea7a-472a-9580-45896f14bf9f None None] Network dee85f4f-de83-4218-8f3b-9f48a95689a9 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:14:10.299531 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8fed662-4321-47a7-a022-2778b3ad8bb5 admin admin] Network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102323) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:14:10.340582 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58c27925-4ed4-419a-bc63-b1ad93a795cf admin admin] Pushing event updated for resources: {'Subnet': ['ID=aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:10.343381 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58c27925-4ed4-419a-bc63-b1ad93a795cf admin admin] Checking segment: {'id': '5eacaa77-ea76-482f-aec2-5adad8f8bde5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 537, 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:14:10.344193 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58c27925-4ed4-419a-bc63-b1ad93a795cf admin admin] Network hostable DHCP agents. Network: 983bda4c-112d-442d-b37a-387818bb1d45, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:14:10.369613 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-33b50f6a-3c38-474d-ad2a-cc1a21c3b00b admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.3680141 Nov 11 17:14:10.388242 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa29423c-1d33-4250-aa1c-ff273afbddd1 None None] Network a98ace73-2226-4e0a-a94f-8a41b5a9a68e requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:14:10.403058 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-a8fed662-4321-47a7-a022-2778b3ad8bb5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f) {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:10.412291 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8fed662-4321-47a7-a022-2778b3ad8bb5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:10.412291 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a8fed662-4321-47a7-a022-2778b3ad8bb5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:10.438768 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5929c4cb-c55c-4ab3-9b7e-ab57820b30bc None None] Network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:14:10.526772 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f4f7f1b-d47c-4b8f-921b-1bedc3fdf307 None None] Network dee85f4f-de83-4218-8f3b-9f48a95689a9 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:14:10.587807 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58c27925-4ed4-419a-bc63-b1ad93a795cf admin admin] Network 983bda4c-112d-442d-b37a-387818bb1d45 is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:14:10.593577 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-a8fed662-4321-47a7-a022-2778b3ad8bb5 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.0101895 Nov 11 17:14:10.597582 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-58c27925-4ed4-419a-bc63-b1ad93a795cf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, 983bda4c-112d-442d-b37a-387818bb1d45) {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:10.598580 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55088) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:10.611778 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58c27925-4ed4-419a-bc63-b1ad93a795cf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:10.612017 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:10.612887 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-58c27925-4ed4-419a-bc63-b1ad93a795cf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:10.620878 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b2d9e95-26df-4b07-8ccb-3059403ca032 None None] Network 983bda4c-112d-442d-b37a-387818bb1d45 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:14:10.783170 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-58c27925-4ed4-419a-bc63-b1ad93a795cf admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 1.1465292 Nov 11 17:14:10.785609 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55096) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:10.790890 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-797046329-router', 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:10.859968 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-424378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7339'] for router, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:10.861074 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-424390', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-397156', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7867629', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7328'] for router, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:10.950887 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-424378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7339'] for router, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:10.953546 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-424390', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-397156', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7867629', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7328'] for router, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:11.011607 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:11.077489 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaac6311d-333a-5f5f-a33c-91960009c34a-4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580'}]}} from dv-cinder-694140-2-iscsi. {{(pid=102325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 17:14:11.078358 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:11.131276 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a02d1ad6-50fc-41d5-a5ad-b07e5a90eb48 None None] Network 983bda4c-112d-442d-b37a-387818bb1d45 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:14:11.163452 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:11.473203 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:11.501077 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.db_base_plugin_common [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Allocated IP 172.20.0.2 (4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f/1a4b11d7-2160-49c3-be78-265f0700c580/eb0a576a-e1ce-45fe-9e7c-89942be0d1e7) {{(pid=102325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:14:11.555933 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:11.608095 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55158) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:11.610203 dv-cinder-694140-2-iscsi neutron-server[102324]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 11 17:14:11.623583 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55160) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:11.628826 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-5f525828-4cec-45fe-98d1-eb7831d30b0a admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1240245093-network', 'tenant_id': 'c1b1c9fcde6f43aebc661f303149f3e6'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:11.723914 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Publish callbacks [] for port, precommit_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:11.762313 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5f525828-4cec-45fe-98d1-eb7831d30b0a admin admin] Made reservation on behalf of c1b1c9fcde6f43aebc661f303149f3e6 for: {'network': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:14:11.764676 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5f525828-4cec-45fe-98d1-eb7831d30b0a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:11.809929 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5f525828-4cec-45fe-98d1-eb7831d30b0a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:11.829485 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624'] for port, after_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:11.880911 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f is already hosted by enough agents. {{(pid=102325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:14:11.884254 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.base_scheduler [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Resources bound (agent type, host, resource id): {{(pid=102325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:11.890046 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Received port after_create {{(pid=102325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:14:11.898420 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Pushing event updated for resources: {'Port': ['ID=eb0a576a-e1ce-45fe-9e7c-89942be0d1e7,revision_number=1']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:11.928014 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:11.928448 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:11.928859 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:11.929278 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:11.929821 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:11.930265 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:11.930688 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:11.931021 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:11.931460 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:11.931849 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:11.932855 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:11.933273 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Tracked resource versions report: Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: pushed versions: Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: { 'AddressGroup': {'1.2'}, Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'ConntrackHelper': {'1.0'}, Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Log': {'1.0'}, Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Network': {'1.1'}, Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Port': {'1.7'}, Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'PortForwarding': {'1.2'}, Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'QosPolicy': {'1.10'}, Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'SecurityGroup': {'1.5'}, Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'SecurityGroupRule': {'1.2'}, Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'SubPort': {'1.0'}, Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Subnet': {'1.1'}, Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Trunk': {'1.1'}} Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: consumer versions: Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: { DHCP agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: HyperV agent@hv-cinder-69414: {}, Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: L3 agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: Metadata agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: Metering agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: Open vSwitch agent@dv-cinder-694140-2-iscsi: { 'AddressGroup': '1.2', Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'ConntrackHelper': '1.0', Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Log': '1.0', Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Network': '1.1', Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Port': '1.7', Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'PortForwarding': '1.2', Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'QosPolicy': '1.10', Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'SecurityGroup': '1.5', Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'SecurityGroupRule': '1.2', Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'SubPort': '1.0', Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Subnet': '1.1', Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: 'Trunk': '1.1'}} Nov 11 17:14:11.934638 dv-cinder-694140-2-iscsi neutron-server[102325]: {{(pid=102325) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 11 17:14:11.941731 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:11.971276 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Attempting to bind port eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:14:11.971785 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Attempting to bind port eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:14:11.972251 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Attempting to bind port eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 on network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:14:11.975552 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:11.979238 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 14, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:14:11.980023 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Checking segment: {'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:14:11.980493 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:11.980958 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Bound using segment: {'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:14:11.981523 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Bound port: eb0a576a-e1ce-45fe-9e7c-89942be0d1e7, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:14:11.982007 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:12.041202 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-0adda83e-cb40-4b90-90bb-8a5daa3ceeab tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:12.047067 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-0adda83e-cb40-4b90-90bb-8a5daa3ceeab tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/networks?id=dee85f4f-de83-4218-8f3b-9f48a95689a9 HTTP/1.1" status: 200 len: 812 time: 0.4378557 Nov 11 17:14:12.062238 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] For port eb0a576a-e1ce-45fe-9e7c-89942be0d1e7, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:14:12.066255 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] For port eb0a576a-e1ce-45fe-9e7c-89942be0d1e7, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=eb0a576a-e1ce-45fe-9e7c-89942be0d1e7,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:14:12.070468 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-e1465cf0-fb29-4aef-b17f-755399cd1fdd tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/quotas/cceb60931e5541518c468df87510c262 HTTP/1.1" status: 200 len: 375 time: 0.0188532 Nov 11 17:14:12.135148 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-6a3e3fd1-5999-46e6-9977-5ea7855911d5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=cceb60931e5541518c468df87510c262&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0551655 Nov 11 17:14:12.136898 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55168) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:12.179816 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:12.252742 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Allocated IP 172.27.1.214 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/1b86e4c7-3038-4da7-86dc-0cffda8e7830) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:14:12.326096 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c30a662-957a-4a5d-8076-0632ace383c3 None None] Pushing event updated for resources: {'Port': ['ID=eb0a576a-e1ce-45fe-9e7c-89942be0d1e7,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:12.393284 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5f525828-4cec-45fe-98d1-eb7831d30b0a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:12.405458 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-6e5aa9be-e919-44b0-9fa6-1e199f4fb7cc admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:12.410490 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-1d4c144d-37f5-4902-bd2d-81f3f430f968 service neutron] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=102324) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 17:14:12.411516 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-1d4c144d-37f5-4902-bd2d-81f3f430f968 service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0707107 Nov 11 17:14:12.456323 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:12.472767 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:12.522030 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:12.522256 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5f525828-4cec-45fe-98d1-eb7831d30b0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:12.534683 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5f525828-4cec-45fe-98d1-eb7831d30b0a admin admin] vlan segment allocate from pool success with {'vlan_id': 504, 'physical_network': 'physnet1'} {{(pid=102323) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:14:12.545030 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5f525828-4cec-45fe-98d1-eb7831d30b0a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:12.545380 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.segments_db [None req-5f525828-4cec-45fe-98d1-eb7831d30b0a admin admin] Added segment 144491ad-646d-4bd3-9925-5d5fef840fc7 of type vlan for network 9e0c6266-3fca-4e42-8562-af5a350cd8c9 Nov 11 17:14:12.589781 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5f525828-4cec-45fe-98d1-eb7831d30b0a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:12.687537 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f525828-4cec-45fe-98d1-eb7831d30b0a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0d940244-ff7b-46eb-93b2-92729444d524,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:12.688698 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-a9c0ca15-d2e6-45a2-84b7-464a47025192 service neutron] 10.222.0.16 "GET /v2.0/networks/dee85f4f-de83-4218-8f3b-9f48a95689a9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2588315 Nov 11 17:14:12.744158 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-6e5aa9be-e919-44b0-9fa6-1e199f4fb7cc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:12.816067 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-4a3e8a3b-7ac4-434a-8ac2-2d1aa2099519 service neutron] 10.222.0.16 "GET /v2.0/networks/dee85f4f-de83-4218-8f3b-9f48a95689a9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1255586 Nov 11 17:14:12.831924 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:12.833958 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5f525828-4cec-45fe-98d1-eb7831d30b0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:12.834959 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f525828-4cec-45fe-98d1-eb7831d30b0a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:12.835563 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5f525828-4cec-45fe-98d1-eb7831d30b0a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:12.836602 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-6e5aa9be-e919-44b0-9fa6-1e199f4fb7cc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:12.926180 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-6e5aa9be-e919-44b0-9fa6-1e199f4fb7cc admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=8bbb84d5262f485ea496b74b7a20e8e6&name=default HTTP/1.1" status: 200 len: 2992 time: 0.7863500 Nov 11 17:14:12.927049 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e5aa9be-e919-44b0-9fa6-1e199f4fb7cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a76cf741-1db2-4352-8acf-4fe79c19ef66,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:12.929628 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55192) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:12.944434 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Allocated IP 172.27.1.93 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/45f4ef34-f554-4b7d-b2f8-8195d31d3841) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:14:12.999097 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:14:13.009075 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-5f525828-4cec-45fe-98d1-eb7831d30b0a admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.3843055 Nov 11 17:14:13.015584 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:13.018334 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:14:13.084760 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55198) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:13.093111 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-33180cbc-9e76-407f-8d10-8edef56dfd10 admin admin] Request body: {'subnet': {'network_id': '9e0c6266-3fca-4e42-8562-af5a350cd8c9', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1240245093-subnet', 'tenant_id': 'c1b1c9fcde6f43aebc661f303149f3e6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:13.162360 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Pushing event updated for resources: {'Port': ['ID=1b86e4c7-3038-4da7-86dc-0cffda8e7830,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:13.172770 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-163860db-5cf2-4b1c-bb91-d3fc0465d8c5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:13.176671 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f525828-4cec-45fe-98d1-eb7831d30b0a admin admin] Pushing event updated for resources: {'Network': ['ID=9e0c6266-3fca-4e42-8562-af5a350cd8c9,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:13.198164 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network 9e0c6266-3fca-4e42-8562-af5a350cd8c9 details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:14:13.264621 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:13.284583 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-163860db-5cf2-4b1c-bb91-d3fc0465d8c5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:13.297095 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55228) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:13.304399 dv-cinder-694140-2-iscsi neutron-server[102323]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 11 17:14:13.313613 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-33180cbc-9e76-407f-8d10-8edef56dfd10 admin admin] Made reservation on behalf of c1b1c9fcde6f43aebc661f303149f3e6 for: {'subnet': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:14:13.315924 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-33180cbc-9e76-407f-8d10-8edef56dfd10 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:13.409404 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:14:13.448694 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7307793d-1205-45f6-8a4a-c204ef23c536 req-4bb4be44-88b2-4b6f-9055-b5fdb6b14533 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 210 time: 0.1504803 Nov 11 17:14:13.483567 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:13.484176 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:13.617043 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:13.625390 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:13.674057 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] For port eb0a576a-e1ce-45fe-9e7c-89942be0d1e7, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=eb0a576a-e1ce-45fe-9e7c-89942be0d1e7,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:13.694018 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Pushing event updated for resources: {'Port': ['ID=45f4ef34-f554-4b7d-b2f8-8195d31d3841,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:13.703418 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:14:13.707924 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-163860db-5cf2-4b1c-bb91-d3fc0465d8c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:13.710898 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-163860db-5cf2-4b1c-bb91-d3fc0465d8c5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:13.721760 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-163860db-5cf2-4b1c-bb91-d3fc0465d8c5 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/a76cf741-1db2-4352-8acf-4fe79c19ef66 HTTP/1.1" status: 204 len: 168 time: 0.7836287 Nov 11 17:14:13.730847 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:13.749470 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:14:13.764889 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-163860db-5cf2-4b1c-bb91-d3fc0465d8c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a76cf741-1db2-4352-8acf-4fe79c19ef66,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:13.800907 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:13.916767 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Pushing event updated for resources: {'Port': ['ID=eb0a576a-e1ce-45fe-9e7c-89942be0d1e7,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:13.916767 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a7c1267-e881-4519-a4c1-1fe327c8aa4b None None] Network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:14:13.971387 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:14.032276 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-6753e823-52da-4d44-862c-41e9697e39a4 None None] Provisioning complete for port eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:14.032550 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-6753e823-52da-4d44-862c-41e9697e39a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:14.156355 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-33180cbc-9e76-407f-8d10-8edef56dfd10 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for subnet, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:14.196425 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:14.219640 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-424501', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-397235'] for router, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:14.279981 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33180cbc-9e76-407f-8d10-8edef56dfd10 admin admin] Pushing event updated for resources: {'Subnet': ['ID=11f67138-c912-412b-b04d-bf72bee47479,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:14.328334 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33180cbc-9e76-407f-8d10-8edef56dfd10 admin admin] Checking segment: {'id': '144491ad-646d-4bd3-9925-5d5fef840fc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '9e0c6266-3fca-4e42-8562-af5a350cd8c9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:14:14.328882 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33180cbc-9e76-407f-8d10-8edef56dfd10 admin admin] Network hostable DHCP agents. Network: 9e0c6266-3fca-4e42-8562-af5a350cd8c9, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:14:14.394983 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-21945960-16a1-47f5-9fdf-e6d526700499 None None] Provisioning complete for port eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:14.396484 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-21945960-16a1-47f5-9fdf-e6d526700499 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:14.454168 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33180cbc-9e76-407f-8d10-8edef56dfd10 admin admin] Network 9e0c6266-3fca-4e42-8562-af5a350cd8c9 is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:14:14.478769 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-424501', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-397235'] for router, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:14.487641 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Router 1a70d97d-215a-45d3-ba2b-b538e79a3278 is scheduled to L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 with binding_index 1 {{(pid=102323) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 17:14:14.705520 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:14:14.717873 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Sync routers for ids ['1a70d97d-215a-45d3-ba2b-b538e79a3278'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:14:14.731378 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Routers {'1a70d97d-215a-45d3-ba2b-b538e79a3278'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:14:14.732549 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:14:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1a70d97d-215a-45d3-ba2b-b538e79a3278'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:14.777238 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-33180cbc-9e76-407f-8d10-8edef56dfd10 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, 9e0c6266-3fca-4e42-8562-af5a350cd8c9) {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:14.782353 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c8b1d61e-6ae3-482a-adb7-3444c758f2b1 req-35a15159-24f6-4237-b04a-e1939230b0ee tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 210 time: 0.2189670 Nov 11 17:14:14.786424 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e6ff8c8-e284-452b-bed2-017a4b16e20f None None] Network 9e0c6266-3fca-4e42-8562-af5a350cd8c9 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:14:14.786902 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33180cbc-9e76-407f-8d10-8edef56dfd10 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:14.787428 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-33180cbc-9e76-407f-8d10-8edef56dfd10 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:14.809714 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] Publish callbacks [] for router, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:14.814151 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-947c0ad5-ba4f-47e5-a719-95bb85d4cf2e admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 4.2116148 Nov 11 17:14:14.814536 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55292) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:14.993742 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-33180cbc-9e76-407f-8d10-8edef56dfd10 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.8966019 Nov 11 17:14:15.013458 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Router 08374e94-6af9-4594-a1ea-925638c38b21 is scheduled to L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 with binding_index 1 {{(pid=102324) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 17:14:15.065266 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dcb721a1-db8c-4399-b438-8bae9bd19c8c None None] Network 9e0c6266-3fca-4e42-8562-af5a350cd8c9 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:14:15.074536 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Set router 1a70d97d-215a-45d3-ba2b-b538e79a3278 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:14:15.177076 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:14:15.272436 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:14:15.279453 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55308) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:15.293293 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Sync routers for ids ['08374e94-6af9-4594-a1ea-925638c38b21'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:14:15.342600 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Routers {'08374e94-6af9-4594-a1ea-925638c38b21'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:14:15.343323 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:14:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['08374e94-6af9-4594-a1ea-925638c38b21'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:15.369609 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_v2 [None req-dc3038af-b275-4c16-97eb-7930f0065f32 admin admin] Deleting subnet 1db18803-fca7-4dcd-9806-8936b94cf1b1 {{(pid=102324) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:14:15.373283 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-dc3038af-b275-4c16-97eb-7930f0065f32 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:15.416026 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-dc3038af-b275-4c16-97eb-7930f0065f32 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:15.421354 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:15.421932 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:15.427035 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-dc3038af-b275-4c16-97eb-7930f0065f32 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:15.494829 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:13Z', 'revision_number': 3, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:15.506787 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] Publish callbacks [] for router, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:15.512538 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-1f05b442-a655-40a7-86b5-e60ba5b1c129 admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 4.7229924 Nov 11 17:14:15.513255 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55312) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:15.531360 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Checking router: 1a70d97d-215a-45d3-ba2b-b538e79a3278 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:14:15.532023 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Updating router 1a70d97d-215a-45d3-ba2b-b538e79a3278 port 1b86e4c7-3038-4da7-86dc-0cffda8e7830 binding host dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:14:15.564837 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:15.608618 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:15.727702 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Set router 08374e94-6af9-4594-a1ea-925638c38b21 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:14:15.751057 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-dc3038af-b275-4c16-97eb-7930f0065f32 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for subnet, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:15.778043 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-dc3038af-b275-4c16-97eb-7930f0065f32 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:15.787584 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-dc3038af-b275-4c16-97eb-7930f0065f32 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/1db18803-fca7-4dcd-9806-8936b94cf1b1 HTTP/1.1" status: 204 len: 168 time: 0.5048382 Nov 11 17:14:15.792927 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55320) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:15.828190 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3038af-b275-4c16-97eb-7930f0065f32 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1db18803-fca7-4dcd-9806-8936b94cf1b1,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:15.905958 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Publish callbacks [] for port, precommit_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:15.916399 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.007610 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.099145 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08374e94-6af9-4594-a1ea-925638c38b21', 'name': 'tempest-ServerRescueNegativeTestJSON-797046329-router', 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93'}], 'enable_snat': True}, 'gw_port_id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:13Z', 'revision_number': 3, 'project_id': 'ed26d137d98846b9b45708f7e581e9b0', 'gw_port': {'id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:79:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08374e94-6af9-4594-a1ea-925638c38b21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:12Z', 'updated_at': '2021-11-11T17:14:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:16.107791 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-537d79f7-f020-41d6-8b92-33e613a94e2a None None] Pushing event updated for resources: {'Port': ['ID=1b86e4c7-3038-4da7-86dc-0cffda8e7830,revision_number=2']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:16.128531 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537d79f7-f020-41d6-8b92-33e613a94e2a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:16.129203 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537d79f7-f020-41d6-8b92-33e613a94e2a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:16.129782 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537d79f7-f020-41d6-8b92-33e613a94e2a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:16.130471 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537d79f7-f020-41d6-8b92-33e613a94e2a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:16.131071 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537d79f7-f020-41d6-8b92-33e613a94e2a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:16.131634 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537d79f7-f020-41d6-8b92-33e613a94e2a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:16.132293 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537d79f7-f020-41d6-8b92-33e613a94e2a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:16.132834 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537d79f7-f020-41d6-8b92-33e613a94e2a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:16.133946 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537d79f7-f020-41d6-8b92-33e613a94e2a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:16.134497 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537d79f7-f020-41d6-8b92-33e613a94e2a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:16.135078 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537d79f7-f020-41d6-8b92-33e613a94e2a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:16.135628 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537d79f7-f020-41d6-8b92-33e613a94e2a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537d79f7-f020-41d6-8b92-33e613a94e2a None None] Tracked resource versions report: Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: pushed versions: Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: { 'AddressGroup': {'1.2'}, Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'ConntrackHelper': {'1.0'}, Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Log': {'1.0'}, Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Network': {'1.1'}, Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Port': {'1.7'}, Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'PortForwarding': {'1.2'}, Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'QosPolicy': {'1.10'}, Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'SecurityGroup': {'1.5'}, Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'SecurityGroupRule': {'1.2'}, Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'SubPort': {'1.0'}, Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Subnet': {'1.1'}, Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Trunk': {'1.1'}} Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: consumer versions: Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: { DHCP agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: HyperV agent@hv-cinder-69414: {}, Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: L3 agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: Metadata agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: Metering agent@dv-cinder-694140-2-iscsi: {}, Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: Open vSwitch agent@dv-cinder-694140-2-iscsi: { 'AddressGroup': '1.2', Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'ConntrackHelper': '1.0', Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Log': '1.0', Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Network': '1.1', Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Port': '1.7', Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'PortForwarding': '1.2', Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'QosPolicy': '1.10', Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'SecurityGroup': '1.5', Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'SecurityGroupRule': '1.2', Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'SubPort': '1.0', Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Subnet': '1.1', Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: 'Trunk': '1.1'}} Nov 11 17:14:16.136992 dv-cinder-694140-2-iscsi neutron-server[102326]: {{(pid=102326) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 11 17:14:16.139087 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Checking router: 08374e94-6af9-4594-a1ea-925638c38b21 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:14:16.139087 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Updating router 08374e94-6af9-4594-a1ea-925638c38b21 port 45f4ef34-f554-4b7d-b2f8-8195d31d3841 binding host dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:14:16.146874 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Attempting to bind port 1b86e4c7-3038-4da7-86dc-0cffda8e7830 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:14:16.148461 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Attempting to bind port 1b86e4c7-3038-4da7-86dc-0cffda8e7830 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:14:16.149606 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Attempting to bind port 1b86e4c7-3038-4da7-86dc-0cffda8e7830 on network 78b17769-6fae-453e-8ae3-4a72e72bccfc {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:14:16.156180 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 14, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:14:16.156953 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Checking segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:14:16.157597 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.158145 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Bound using segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:14:16.158911 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Bound port: 1b86e4c7-3038-4da7-86dc-0cffda8e7830, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:14:16.159473 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.177620 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.190774 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.231256 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] For port 1b86e4c7-3038-4da7-86dc-0cffda8e7830, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:14:16.235365 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] For port 1b86e4c7-3038-4da7-86dc-0cffda8e7830, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=1b86e4c7-3038-4da7-86dc-0cffda8e7830,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:14:16.273068 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-953b7461-119e-420f-b5d8-8fd6642f6026 req-d6d48bb1-c712-4759-83ce-5d1ae0b79923 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 210 time: 0.1007085 Nov 11 17:14:16.279832 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.329565 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:16.329955 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:16.330739 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:16.331076 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Subscribe: > port after_create 55550000 {{(pid=102323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:16.331397 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Subscribe: > port after_delete 55550000 {{(pid=102323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:16.337064 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Subscribe: > port after_update 55550000 {{(pid=102323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:16.337064 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:16.337064 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:16.337064 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:16.337064 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:16.364209 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.366640 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.480108 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-537d79f7-f020-41d6-8b92-33e613a94e2a None None] Pushing event updated for resources: {'Port': ['ID=1b86e4c7-3038-4da7-86dc-0cffda8e7830,revision_number=3']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:16.483707 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Routers {'1a70d97d-215a-45d3-ba2b-b538e79a3278'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:14:16.484313 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:14:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1a70d97d-215a-45d3-ba2b-b538e79a3278'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:16.619169 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Allocated IP 172.20.0.1 (983bda4c-112d-442d-b37a-387818bb1d45/aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4/94af5a65-b91a-4134-9a23-8e8a8229d743) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:14:16.643312 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Publish callbacks [] for port, precommit_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.668793 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] Set router 1a70d97d-215a-45d3-ba2b-b538e79a3278 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:14:16.729924 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:16.733807 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:16.733807 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:16.733807 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:16.733807 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a98ace73-2226-4e0a-a94f-8a41b5a9a68e']}} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:16.759812 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '08a339d2-f0ca-49a4-b7a6-31aa65d05381') {'for_net_delete': True} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:16.764831 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '08a339d2-f0ca-49a4-b7a6-31aa65d05381') {} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:16.776668 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Allocated IP 172.20.0.1 (4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f/1a4b11d7-2160-49c3-be78-265f0700c580/aa2fc75b-4ee8-4417-b781-eb1c551f1c43) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:14:16.786132 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5777070'] for segment, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.786773 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.800809 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.824013 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.845666 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Attempting to bind port 45f4ef34-f554-4b7d-b2f8-8195d31d3841 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:14:16.846047 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Attempting to bind port 45f4ef34-f554-4b7d-b2f8-8195d31d3841 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:14:16.846415 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Attempting to bind port 45f4ef34-f554-4b7d-b2f8-8195d31d3841 on network 78b17769-6fae-453e-8ae3-4a72e72bccfc {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:14:16.876253 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 14, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:14:16.876697 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Checking segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:14:16.877105 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.877560 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Bound using segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:14:16.878370 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Bound port: 45f4ef34-f554-4b7d-b2f8-8195d31d3841, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:14:16.878858 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.885903 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Releasing vlan 545 on physical network physnet1 to pool {{(pid=102323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:14:16.886230 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5720605'] for segment, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: from cryptography.utils import int_from_bytes Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: from cryptography.utils import int_from_bytes Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: Traceback (most recent call last): Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: timer() Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: cb(*args, **kw) Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: return func(*args, **kwargs) Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: self._notify() Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: self.callback(batched_events) Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: event.method(event) Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: return f(self, *a, **k) Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._get(url).json() Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: return self.request(url, 'GET', **kwargs) Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:14:16.890419 dv-cinder-694140-2-iscsi neutron-server[102323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:14:16.943673 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] For port 45f4ef34-f554-4b7d-b2f8-8195d31d3841, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:14:16.948525 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] For port 45f4ef34-f554-4b7d-b2f8-8195d31d3841, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=45f4ef34-f554-4b7d-b2f8-8195d31d3841,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:14:16.960556 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-266a47ad-1d2f-4eed-9459-a8188c236fea None None] Pushing event updated for resources: {'Port': ['ID=45f4ef34-f554-4b7d-b2f8-8195d31d3841,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:16.967105 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:13Z', 'revision_number': 3, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:16.991766 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:17.000948 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b15e6b33-d301-4182-85f5-099dc64d0fc8 None None] The sync data for ids ['1a70d97d-215a-45d3-ba2b-b538e79a3278'] in dv-cinder-694140-2-iscsi is: [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:13Z', 'revision_number': 3, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:14:17.023448 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:17.040336 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:17.043549 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Network 983bda4c-112d-442d-b37a-387818bb1d45 is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:14:17.047334 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:17.051707 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:14:17.052416 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-394084'] for router_interface, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:17.083594 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:17.119276 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:17.124686 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] 10.222.0.16 "DELETE /v2.0/networks/a98ace73-2226-4e0a-a94f-8a41b5a9a68e HTTP/1.1" status: 204 len: 168 time: 1.3296349 Nov 11 17:14:17.134663 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55360) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:17.136741 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36c908a7-316e-40e5-a1f4-c9ff7436626e admin admin] Pushing event deleted for resources: {'Network': ['ID=a98ace73-2226-4e0a-a94f-8a41b5a9a68e,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:17.145911 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-266a47ad-1d2f-4eed-9459-a8188c236fea None None] Pushing event updated for resources: {'Port': ['ID=45f4ef34-f554-4b7d-b2f8-8195d31d3841,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:17.185609 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Routers {'08374e94-6af9-4594-a1ea-925638c38b21'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:14:17.186458 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:14:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['08374e94-6af9-4594-a1ea-925638c38b21'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:17.199350 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:17.241925 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Pushing event updated for resources: {'Port': ['ID=94af5a65-b91a-4134-9a23-8e8a8229d743,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:17.280846 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_v2 [None req-4e678cf1-5d42-4ce4-ac93-74e3442b5fde admin admin] Deleting subnet 11f67138-c912-412b-b04d-bf72bee47479 {{(pid=102324) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:14:17.290334 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Pushing event updated for resources: {'Port': ['ID=aa2fc75b-4ee8-4417-b781-eb1c551f1c43,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:17.302020 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-4e678cf1-5d42-4ce4-ac93-74e3442b5fde admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:17.322360 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:14:17.323860 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:17.346512 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:14:17.356480 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] Set router 08374e94-6af9-4594-a1ea-925638c38b21 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:14:17.455836 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-394084'] for router_interface, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:17.486187 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-4e678cf1-5d42-4ce4-ac93-74e3442b5fde admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:17.507880 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-4e678cf1-5d42-4ce4-ac93-74e3442b5fde admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:17.669311 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d00a2da7-a52d-4b29-bac5-621fc8917682 req-4c764d09-544e-498d-b134-a593b772bc31 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 210 time: 0.0473409 Nov 11 17:14:17.677080 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:17.732719 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08374e94-6af9-4594-a1ea-925638c38b21', 'name': 'tempest-ServerRescueNegativeTestJSON-797046329-router', 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93'}], 'enable_snat': True}, 'gw_port_id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:13Z', 'revision_number': 3, 'project_id': 'ed26d137d98846b9b45708f7e581e9b0', 'gw_port': {'id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:79:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08374e94-6af9-4594-a1ea-925638c38b21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:12Z', 'updated_at': '2021-11-11T17:14:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:17.765651 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfdb0d55-8f04-486b-95d3-6bb03029b7fe None None] The sync data for ids ['08374e94-6af9-4594-a1ea-925638c38b21'] in dv-cinder-694140-2-iscsi is: [{'id': '08374e94-6af9-4594-a1ea-925638c38b21', 'name': 'tempest-ServerRescueNegativeTestJSON-797046329-router', 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93'}], 'enable_snat': True}, 'gw_port_id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:13Z', 'revision_number': 3, 'project_id': 'ed26d137d98846b9b45708f7e581e9b0', 'gw_port': {'id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:79:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08374e94-6af9-4594-a1ea-925638c38b21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:12Z', 'updated_at': '2021-11-11T17:14:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:14:17.782027 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-b759c160-3027-49d8-a848-cf317a8d86eb None None] Provisioning complete for port aa2fc75b-4ee8-4417-b781-eb1c551f1c43 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:17.782572 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b759c160-3027-49d8-a848-cf317a8d86eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:17.842212 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-b759c160-3027-49d8-a848-cf317a8d86eb None None] Port aa2fc75b-4ee8-4417-b781-eb1c551f1c43 cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:14:17.941105 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:17.979833 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-4e678cf1-5d42-4ce4-ac93-74e3442b5fde admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for subnet, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:17.989524 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:18.030178 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e678cf1-5d42-4ce4-ac93-74e3442b5fde admin admin] Pushing event deleted for resources: {'Subnet': ['ID=11f67138-c912-412b-b04d-bf72bee47479,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:18.075155 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-4e678cf1-5d42-4ce4-ac93-74e3442b5fde admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:18.089625 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-4e678cf1-5d42-4ce4-ac93-74e3442b5fde admin admin] 10.222.0.16 "DELETE /v2.0/subnets/11f67138-c912-412b-b04d-bf72bee47479 HTTP/1.1" status: 204 len: 168 time: 0.9479206 Nov 11 17:14:18.089625 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55402) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:18.269758 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.10', 50514) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:18.380254 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:18.380972 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8103788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-394224'] for router_interface, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:18.454451 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:18.809294 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-ad30fffb-9f92-47c3-b9f5-3cdef8a16b5d tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:18.809294 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-ad30fffb-9f92-47c3-b9f5-3cdef8a16b5d tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.10 "GET /v2.0/networks?id=dee85f4f-de83-4218-8f3b-9f48a95689a9 HTTP/1.1" status: 200 len: 812 time: 0.2980423 Nov 11 17:14:18.811206 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:18.811206 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Pushing event updated for resources: {'Port': ['ID=94af5a65-b91a-4134-9a23-8e8a8229d743,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:18.812928 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:18.812928 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-076f6d81-456e-4d8a-823b-2c2be323f7a5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Request body: {'port': {'device_id': 'a653c39c-4234-4aa6-bfbb-d867ce904738', 'network_id': 'dee85f4f-de83-4218-8f3b-9f48a95689a9', 'admin_state_up': True, 'tenant_id': 'cceb60931e5541518c468df87510c262'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:18.814066 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Network 983bda4c-112d-442d-b37a-387818bb1d45 is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:14:18.814066 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:18.814066 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:18.814066 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55424) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:18.863469 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Pushing event updated for resources: {'Port': ['ID=aa2fc75b-4ee8-4417-b781-eb1c551f1c43,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:18.874102 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8103788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-394224'] for router_interface, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:18.964614 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:18.965875 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55432) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:18.966617 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:18.967432 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:18.967833 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Subscribe: > port after_create 55550000 {{(pid=102324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:18.968995 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Subscribe: > port after_delete 55550000 {{(pid=102324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:18.969328 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Subscribe: > port after_update 55550000 {{(pid=102324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:18.969654 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:18.969982 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:18.970306 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:18.970655 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:19.200161 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 45f4ef34-f554-4b7d-b2f8-8195d31d3841 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:14:19.302903 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 45f4ef34-f554-4b7d-b2f8-8195d31d3841 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:19.302903 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:19.330641 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:14:19.332452 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:19.387767 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:19.389159 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:19.389159 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:19.389159 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 17:14:19.389159 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9e0c6266-3fca-4e42-8562-af5a350cd8c9']}} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:19.421678 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '144491ad-646d-4bd3-9925-5d5fef840fc7') {'for_net_delete': True} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:19.422450 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '144491ad-646d-4bd3-9925-5d5fef840fc7') {} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:19.448879 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:19.458500 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ce8c31e9-6e3b-440d-a73c-7daf26ba35af admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:19.479016 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-076f6d81-456e-4d8a-823b-2c2be323f7a5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Made reservation on behalf of cceb60931e5541518c468df87510c262 for: {'port': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:14:19.480658 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5895812'] for segment, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:19.484268 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-076f6d81-456e-4d8a-823b-2c2be323f7a5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:19.513139 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] For port 45f4ef34-f554-4b7d-b2f8-8195d31d3841, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=45f4ef34-f554-4b7d-b2f8-8195d31d3841,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:19.544364 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b646b5b8-0c8b-48a3-bbc3-33cf303a4fe4 req-93e7df46-1353-4ec7-b74c-71c495f8e262 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 210 time: 0.5950363 Nov 11 17:14:19.545191 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-174c3728-b918-43b0-8c9e-8e5094006ce9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:19.557974 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Router 08374e94-6af9-4594-a1ea-925638c38b21 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:14:19.588581 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:19.613792 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:19.614141 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Releasing vlan 504 on physical network physnet1 to pool {{(pid=102324) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:14:19.614578 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5436270'] for segment, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:19.615926 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 1b86e4c7-3038-4da7-86dc-0cffda8e7830 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: from cryptography.utils import int_from_bytes Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: from cryptography.utils import int_from_bytes Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: Traceback (most recent call last): Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: timer() Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: cb(*args, **kw) Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: return func(*args, **kwargs) Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: self._notify() Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: self.callback(batched_events) Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: event.method(event) Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: return f(self, *a, **k) Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: return self._get(url).json() Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: return self.request(url, 'GET', **kwargs) Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:14:19.655184 dv-cinder-694140-2-iscsi neutron-server[102324]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:14:19.667662 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55456) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:19.814240 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 1b86e4c7-3038-4da7-86dc-0cffda8e7830 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:19.814240 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:19.826642 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:14:19.853465 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-87dcc05b-2fd2-4b10-949d-c75d9be230ac admin admin] 10.222.0.16 "PUT /v2.0/routers/08374e94-6af9-4594-a1ea-925638c38b21/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.3352563 Nov 11 17:14:19.875201 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Pushing event updated for resources: {'Port': ['ID=45f4ef34-f554-4b7d-b2f8-8195d31d3841,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:19.876994 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e9a497ec-964b-4738-963a-20a0bf3a32f2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:19.912125 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-7b78405a-def8-43c4-8929-790080d7ee88 None None] Provisioning complete for port aa2fc75b-4ee8-4417-b781-eb1c551f1c43 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:19.912431 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-7b78405a-def8-43c4-8929-790080d7ee88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:19.991425 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Router 1a70d97d-215a-45d3-ba2b-b538e79a3278 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:14:20.001622 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-7b78405a-def8-43c4-8929-790080d7ee88 None None] Port aa2fc75b-4ee8-4417-b781-eb1c551f1c43 cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:14:20.010459 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e9a497ec-964b-4738-963a-20a0bf3a32f2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.012298 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.012455 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.052254 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] For port 1b86e4c7-3038-4da7-86dc-0cffda8e7830, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=1b86e4c7-3038-4da7-86dc-0cffda8e7830,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:20.054011 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.056117 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-076f6d81-456e-4d8a-823b-2c2be323f7a5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Allocated IP 172.20.0.2 (dee85f4f-de83-4218-8f3b-9f48a95689a9/e608e66c-e895-4298-9bef-647d1d33f98e/fd585263-ae7c-46ac-bb91-f0e1daa4026d) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:14:20.061715 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] 10.222.0.16 "DELETE /v2.0/networks/9e0c6266-3fca-4e42-8562-af5a350cd8c9 HTTP/1.1" status: 204 len: 168 time: 1.9743435 Nov 11 17:14:20.068752 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb9c6829-0c83-4860-b3cb-888336ece0e0 admin admin] Pushing event deleted for resources: {'Network': ['ID=9e0c6266-3fca-4e42-8562-af5a350cd8c9,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:20.135219 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.172732 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e9a497ec-964b-4738-963a-20a0bf3a32f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.172732 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-174c3728-b918-43b0-8c9e-8e5094006ce9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.236020 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-e9a497ec-964b-4738-963a-20a0bf3a32f2 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=de3d593ae8f64484a9df99f8d96171a0&name=default HTTP/1.1" status: 200 len: 2992 time: 0.5645585 Nov 11 17:14:20.236020 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9a497ec-964b-4738-963a-20a0bf3a32f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=866ed690-a794-43a5-b0d5-b0d305b00247,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:20.237961 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55484) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:20.255536 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Pushing event updated for resources: {'Port': ['ID=1b86e4c7-3038-4da7-86dc-0cffda8e7830,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:20.293966 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9d1ec515-dd72-4f1f-adde-637d1cd04b35 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.306928 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ce8c31e9-6e3b-440d-a73c-7daf26ba35af admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.329876 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9d1ec515-dd72-4f1f-adde-637d1cd04b35 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.361734 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:14:20.378643 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-d9b68d22-d880-4b9d-8653-9865a555480a admin admin] 10.222.0.16 "PUT /v2.0/routers/1a70d97d-215a-45d3-ba2b-b538e79a3278/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.5540149 Nov 11 17:14:20.379163 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Sync routers for ids ['1a70d97d-215a-45d3-ba2b-b538e79a3278'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:14:20.389481 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Routers {'1a70d97d-215a-45d3-ba2b-b538e79a3278'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:14:20.390531 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:14:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1a70d97d-215a-45d3-ba2b-b538e79a3278'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:20.436114 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-174c3728-b918-43b0-8c9e-8e5094006ce9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.477713 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-174c3728-b918-43b0-8c9e-8e5094006ce9 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=c691c2216e2241449729ab2b57f3cea3&name=default HTTP/1.1" status: 200 len: 2992 time: 1.6789596 Nov 11 17:14:20.478043 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-174c3728-b918-43b0-8c9e-8e5094006ce9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a91959d-4d1d-406e-8b3a-1ec32960a582,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:20.480225 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55502) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:20.522056 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9d1ec515-dd72-4f1f-adde-637d1cd04b35 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.525474 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9d1ec515-dd72-4f1f-adde-637d1cd04b35 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.529689 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-9d1ec515-dd72-4f1f-adde-637d1cd04b35 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/866ed690-a794-43a5-b0d5-b0d305b00247 HTTP/1.1" status: 204 len: 168 time: 0.2906132 Nov 11 17:14:20.531936 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ce8c31e9-6e3b-440d-a73c-7daf26ba35af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.541373 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d1ec515-dd72-4f1f-adde-637d1cd04b35 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=866ed690-a794-43a5-b0d5-b0d305b00247,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:20.547288 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Set router 1a70d97d-215a-45d3-ba2b-b538e79a3278 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:14:20.579639 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce8c31e9-6e3b-440d-a73c-7daf26ba35af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=175ee339-9a11-4a6c-87ac-78e32cf76f83,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:20.702914 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-ce8c31e9-6e3b-440d-a73c-7daf26ba35af admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=54d914912f14454eb3a0e20f2354fee0&name=default HTTP/1.1" status: 200 len: 2992 time: 1.7318251 Nov 11 17:14:20.703911 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1295c178-a51a-4073-9b16-2a6dcd0d4aa5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.705705 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55514) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:20.710572 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-076f6d81-456e-4d8a-823b-2c2be323f7a5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.718768 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Sync routers for ids ['08374e94-6af9-4594-a1ea-925638c38b21'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:14:20.748757 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-c80a5a80-2d17-449c-ac91-54479f9fc4f5 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:20.756130 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-c80a5a80-2d17-449c-ac91-54479f9fc4f5 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/networks?id=983bda4c-112d-442d-b37a-387818bb1d45 HTTP/1.1" status: 200 len: 818 time: 0.3765295 Nov 11 17:14:20.777268 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Routers {'08374e94-6af9-4594-a1ea-925638c38b21'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:14:20.777903 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:14:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['08374e94-6af9-4594-a1ea-925638c38b21'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:20.808714 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-f11389ef-1b56-4c1c-8418-792a8588c893 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/quotas/ed26d137d98846b9b45708f7e581e9b0 HTTP/1.1" status: 200 len: 375 time: 0.0490789 Nov 11 17:14:20.811055 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1295c178-a51a-4073-9b16-2a6dcd0d4aa5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.831386 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fc2dc668-d6d8-419d-8c0b-654a0958ffdf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.870446 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fc2dc668-d6d8-419d-8c0b-654a0958ffdf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.912612 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55520) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:20.990924 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fc2dc668-d6d8-419d-8c0b-654a0958ffdf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.994629 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fc2dc668-d6d8-419d-8c0b-654a0958ffdf admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:20.996961 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-fc2dc668-d6d8-419d-8c0b-654a0958ffdf admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/175ee339-9a11-4a6c-87ac-78e32cf76f83 HTTP/1.1" status: 204 len: 168 time: 0.2892904 Nov 11 17:14:20.997734 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-aae307f1-9b54-4ecf-b99b-00b30d2397f4 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=ed26d137d98846b9b45708f7e581e9b0&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1737766 Nov 11 17:14:21.006224 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'aa2fc75b-4ee8-4417-b781-eb1c551f1c43', 'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'mac_address': 'fa:16:3e:61:80:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:15Z', 'updated_at': '2021-11-11T17:14:18Z', 'revision_number': 2, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'subnets': [{'id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:21.016029 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-7c74a56e-1156-4a1f-8c90-74ed02a30180 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=34577e94e3cb42d6b73cd1f88c6f8b80&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0858452 Nov 11 17:14:21.016792 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55526) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:21.019153 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Set router 08374e94-6af9-4594-a1ea-925638c38b21 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:14:21.035103 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc2dc668-d6d8-419d-8c0b-654a0958ffdf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=175ee339-9a11-4a6c-87ac-78e32cf76f83,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:21.068936 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-076f6d81-456e-4d8a-823b-2c2be323f7a5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:21.095170 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Checking router: 1a70d97d-215a-45d3-ba2b-b538e79a3278 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:14:21.095736 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Updating router 1a70d97d-215a-45d3-ba2b-b538e79a3278 port aa2fc75b-4ee8-4417-b781-eb1c551f1c43 binding host dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:14:21.170809 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 45f4ef34-f554-4b7d-b2f8-8195d31d3841 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:14:21.182137 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:21.254832 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1295c178-a51a-4073-9b16-2a6dcd0d4aa5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:21.267240 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1295c178-a51a-4073-9b16-2a6dcd0d4aa5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:21.269876 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-1295c178-a51a-4073-9b16-2a6dcd0d4aa5 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/7a91959d-4d1d-406e-8b3a-1ec32960a582 HTTP/1.1" status: 204 len: 168 time: 0.7868810 Nov 11 17:14:21.358095 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1295c178-a51a-4073-9b16-2a6dcd0d4aa5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a91959d-4d1d-406e-8b3a-1ec32960a582,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:21.361807 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-076f6d81-456e-4d8a-823b-2c2be323f7a5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Network dee85f4f-de83-4218-8f3b-9f48a95689a9 is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:14:21.376331 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-076f6d81-456e-4d8a-823b-2c2be323f7a5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:21.380449 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-076f6d81-456e-4d8a-823b-2c2be323f7a5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Pushing event updated for resources: {'Port': ['ID=fd585263-ae7c-46ac-bb91-f0e1daa4026d,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:21.399477 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-076f6d81-456e-4d8a-823b-2c2be323f7a5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:14:21.476479 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 45f4ef34-f554-4b7d-b2f8-8195d31d3841 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:21.477621 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:21.497910 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-076f6d81-456e-4d8a-823b-2c2be323f7a5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:21.500963 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-076f6d81-456e-4d8a-823b-2c2be323f7a5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:21.527766 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-dd395975-3960-449d-b373-e710ed032da1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:21.619502 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08374e94-6af9-4594-a1ea-925638c38b21', 'name': 'tempest-ServerRescueNegativeTestJSON-797046329-router', 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93'}], 'enable_snat': True}, 'gw_port_id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': 'ed26d137d98846b9b45708f7e581e9b0', 'gw_port': {'id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:79:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08374e94-6af9-4594-a1ea-925638c38b21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:12Z', 'updated_at': '2021-11-11T17:14:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '94af5a65-b91a-4134-9a23-8e8a8229d743', 'name': '', 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45', 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0', 'mac_address': 'fa:16:3e:38:00:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08374e94-6af9-4594-a1ea-925638c38b21', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:16Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 2, 'project_id': 'ed26d137d98846b9b45708f7e581e9b0', 'subnets': [{'id': 'aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:21.634536 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-dd395975-3960-449d-b373-e710ed032da1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:21.730985 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-076f6d81-456e-4d8a-823b-2c2be323f7a5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.1024263 Nov 11 17:14:21.738511 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Publish callbacks [] for port, precommit_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:21.796534 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-dd395975-3960-449d-b373-e710ed032da1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:21.805069 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-dd395975-3960-449d-b373-e710ed032da1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:21.809548 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-dd395975-3960-449d-b373-e710ed032da1 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/651d5e8b-43c3-4632-9731-13c745d1f8cb HTTP/1.1" status: 204 len: 168 time: 0.7887480 Nov 11 17:14:21.818337 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-622eb624-2ebb-45e6-a427-242d7cabe0bb tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=102323) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 17:14:21.824311 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-622eb624-2ebb-45e6-a427-242d7cabe0bb tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0158253 Nov 11 17:14:21.824779 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:21.840913 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd395975-3960-449d-b373-e710ed032da1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=651d5e8b-43c3-4632-9731-13c745d1f8cb,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:21.889776 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Checking router: 08374e94-6af9-4594-a1ea-925638c38b21 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:14:21.890061 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Updating router 08374e94-6af9-4594-a1ea-925638c38b21 port 94af5a65-b91a-4134-9a23-8e8a8229d743 binding host dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:14:21.898104 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54646139-f031-4973-a7d8-be01eb5fc653 None None] Pushing event updated for resources: {'Port': ['ID=aa2fc75b-4ee8-4417-b781-eb1c551f1c43,revision_number=3']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:21.917015 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 1b86e4c7-3038-4da7-86dc-0cffda8e7830 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:14:21.948804 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:21.970867 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Attempting to bind port aa2fc75b-4ee8-4417-b781-eb1c551f1c43 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:14:21.971230 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Attempting to bind port aa2fc75b-4ee8-4417-b781-eb1c551f1c43 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:14:21.971601 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Attempting to bind port aa2fc75b-4ee8-4417-b781-eb1c551f1c43 on network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:14:21.980186 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 14, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:14:21.980711 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Checking segment: {'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:14:21.981110 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:21.981503 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Bound using segment: {'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:14:21.982104 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Bound port: aa2fc75b-4ee8-4417-b781-eb1c551f1c43, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'}}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:14:21.982628 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:22.030934 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55542) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:22.037938 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-0c760b16-285b-45e0-994a-72235a521144 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Request body: {'security_group': {'name': 'tempest-securitygroup--717032521', 'description': 'tempest-description--333795585'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:22.137175 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] For port aa2fc75b-4ee8-4417-b781-eb1c551f1c43, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:14:22.141700 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] For port aa2fc75b-4ee8-4417-b781-eb1c551f1c43, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=aa2fc75b-4ee8-4417-b781-eb1c551f1c43,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:14:22.145335 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 1b86e4c7-3038-4da7-86dc-0cffda8e7830 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:22.145708 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:22.171640 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55544) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:22.213547 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1cf839ee-edf5-4e0d-a4d3-58ed304caa3d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:22.221848 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-0c760b16-285b-45e0-994a-72235a521144 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:22.270566 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:22.290765 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5036c72a-053c-47c7-8cac-9d217ab57bfb req-f7472fcf-0396-430c-9b39-30d723af836d tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:22.293018 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5036c72a-053c-47c7-8cac-9d217ab57bfb req-f7472fcf-0396-430c-9b39-30d723af836d tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 931 time: 0.1460938 Nov 11 17:14:22.333646 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4c7e66c3-0f19-471d-a0ed-82820b7065fd None None] Provisioning complete for port aa2fc75b-4ee8-4417-b781-eb1c551f1c43 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:22.342121 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4c7e66c3-0f19-471d-a0ed-82820b7065fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:22.349079 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54646139-f031-4973-a7d8-be01eb5fc653 None None] Pushing event updated for resources: {'Port': ['ID=aa2fc75b-4ee8-4417-b781-eb1c551f1c43,revision_number=4']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:22.408587 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Routers {'1a70d97d-215a-45d3-ba2b-b538e79a3278'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:14:22.410403 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:14:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1a70d97d-215a-45d3-ba2b-b538e79a3278'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:22.443208 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5036c72a-053c-47c7-8cac-9d217ab57bfb req-1e944b18-e1a6-4570-9ee5-692e3f1d9872 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1235766 Nov 11 17:14:22.713521 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] Set router 1a70d97d-215a-45d3-ba2b-b538e79a3278 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:14:22.745602 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4c7e66c3-0f19-471d-a0ed-82820b7065fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:22.774024 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Publish callbacks [] for port, precommit_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:22.785932 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-0c760b16-285b-45e0-994a-72235a521144 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:22.831450 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4c7e66c3-0f19-471d-a0ed-82820b7065fd None None] For port aa2fc75b-4ee8-4417-b781-eb1c551f1c43, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=aa2fc75b-4ee8-4417-b781-eb1c551f1c43,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:22.832902 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1cf839ee-edf5-4e0d-a4d3-58ed304caa3d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:22.904809 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:22.908080 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-02ba5c38-0e02-4b17-9f12-28fc8336351f service neutron] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=102323) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 17:14:22.909364 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-02ba5c38-0e02-4b17-9f12-28fc8336351f service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.5193174 Nov 11 17:14:22.911006 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-0c760b16-285b-45e0-994a-72235a521144 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:22.980514 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1cf839ee-edf5-4e0d-a4d3-58ed304caa3d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:23.013037 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'aa2fc75b-4ee8-4417-b781-eb1c551f1c43', 'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'mac_address': 'fa:16:3e:61:80:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:15Z', 'updated_at': '2021-11-11T17:14:22Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'subnets': [{'id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:23.025305 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4c7e66c3-0f19-471d-a0ed-82820b7065fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:23.033604 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c760b16-285b-45e0-994a-72235a521144 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0acab519-6858-46d7-8130-5f8ede58987f,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:23.057309 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fda6faaa-931a-4492-aa2f-737f81101d35 None None] The sync data for ids ['1a70d97d-215a-45d3-ba2b-b538e79a3278'] in dv-cinder-694140-2-iscsi is: [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'aa2fc75b-4ee8-4417-b781-eb1c551f1c43', 'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'mac_address': 'fa:16:3e:61:80:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:15Z', 'updated_at': '2021-11-11T17:14:22Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'subnets': [{'id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:14:23.075032 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2165b713-c901-4fe4-87c0-78c79d4a73ec None None] Pushing event updated for resources: {'Port': ['ID=94af5a65-b91a-4134-9a23-8e8a8229d743,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:23.091821 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55568) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:23.099258 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-1cf839ee-edf5-4e0d-a4d3-58ed304caa3d admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=84c50d971c504690aab3eaecbaad3b64&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9261894 Nov 11 17:14:23.109815 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55570) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:23.128828 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-0c760b16-285b-45e0-994a-72235a521144 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:23.133042 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-0c760b16-285b-45e0-994a-72235a521144 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 1.0965097 Nov 11 17:14:23.146112 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55574) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:23.179079 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-a208d7eb-3daf-40b5-8ee8-fd5f829160bc tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Request body: {'security_group_rule': {'security_group_id': '0acab519-6858-46d7-8130-5f8ede58987f', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:23.188328 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf839ee-edf5-4e0d-a4d3-58ed304caa3d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a9fc3a30-9b05-48d5-8f9b-6d8870878664,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:23.236592 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-0e655b85-1df5-4621-925e-6d6a4c8b9019 service neutron] 10.222.0.16 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3121908 Nov 11 17:14:23.285018 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c7e66c3-0f19-471d-a0ed-82820b7065fd None None] Pushing event updated for resources: {'Port': ['ID=aa2fc75b-4ee8-4417-b781-eb1c551f1c43,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:23.354179 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-797ce30a-3787-473b-9091-008e45d32534 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:23.376902 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Attempting to bind port 94af5a65-b91a-4134-9a23-8e8a8229d743 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:14:23.377463 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Attempting to bind port 94af5a65-b91a-4134-9a23-8e8a8229d743 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '5eacaa77-ea76-482f-aec2-5adad8f8bde5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 537, 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:14:23.377918 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Attempting to bind port 94af5a65-b91a-4134-9a23-8e8a8229d743 on network 983bda4c-112d-442d-b37a-387818bb1d45 {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:14:23.385757 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 14, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:14:23.386276 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Checking segment: {'id': '5eacaa77-ea76-482f-aec2-5adad8f8bde5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 537, 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:14:23.386807 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:23.387307 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Bound using segment: {'id': '5eacaa77-ea76-482f-aec2-5adad8f8bde5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 537, 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:14:23.387978 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Bound port: 94af5a65-b91a-4134-9a23-8e8a8229d743, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5eacaa77-ea76-482f-aec2-5adad8f8bde5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 537, 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:14:23.388565 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:23.408972 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-60865a23-6956-43b5-a333-024175679dd0 None None] Provisioning complete for port aa2fc75b-4ee8-4417-b781-eb1c551f1c43 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:23.409407 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-60865a23-6956-43b5-a333-024175679dd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:23.483102 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b590cdd9-cd27-47e2-8218-a38be254f1ca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:23.530166 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Request body: {'port': {'device_id': 'a653c39c-4234-4aa6-bfbb-d867ce904738', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:23.626982 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] For port 94af5a65-b91a-4134-9a23-8e8a8229d743, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:14:23.631666 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] For port 94af5a65-b91a-4134-9a23-8e8a8229d743, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=94af5a65-b91a-4134-9a23-8e8a8229d743,segment=NetworkSegment(5eacaa77-ea76-482f-aec2-5adad8f8bde5),segment_id=5eacaa77-ea76-482f-aec2-5adad8f8bde5)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:14:23.705962 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-797ce30a-3787-473b-9091-008e45d32534 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:23.773511 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:23.781066 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b590cdd9-cd27-47e2-8218-a38be254f1ca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:23.876298 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2165b713-c901-4fe4-87c0-78c79d4a73ec None None] Pushing event updated for resources: {'Port': ['ID=94af5a65-b91a-4134-9a23-8e8a8229d743,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:23.922675 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Routers {'08374e94-6af9-4594-a1ea-925638c38b21'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:14:23.923771 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:14:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['08374e94-6af9-4594-a1ea-925638c38b21'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:23.938087 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0cc53a2-f588-41d1-885b-42d412543eba req-6a5ab627-2dd7-44b5-a28b-800dc5bfd7a5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:23.939963 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e0cc53a2-f588-41d1-885b-42d412543eba req-6a5ab627-2dd7-44b5-a28b-800dc5bfd7a5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 931 time: 0.2493393 Nov 11 17:14:23.992338 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-a55e8025-9cfd-4bb8-8363-a6af52f3e3ee service neutron] 10.222.0.16 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7412455 Nov 11 17:14:23.996344 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a208d7eb-3daf-40b5-8ee8-fd5f829160bc tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:24.001028 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-797ce30a-3787-473b-9091-008e45d32534 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:24.148780 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:24.225774 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-797ce30a-3787-473b-9091-008e45d32534 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fff2f5f2-0eb2-44b5-8aec-14b7279abcc5,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:24.256673 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] Set router 08374e94-6af9-4594-a1ea-925638c38b21 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:14:24.263415 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e0cc53a2-f588-41d1-885b-42d412543eba req-62de67fa-d1fa-4ab1-a8d5-119f02e3333f tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3135762 Nov 11 17:14:24.263784 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a208d7eb-3daf-40b5-8ee8-fd5f829160bc tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:24.264919 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b590cdd9-cd27-47e2-8218-a38be254f1ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:24.267898 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b590cdd9-cd27-47e2-8218-a38be254f1ca admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:24.269850 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-b590cdd9-cd27-47e2-8218-a38be254f1ca admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/a9fc3a30-9b05-48d5-8f9b-6d8870878664 HTTP/1.1" status: 204 len: 168 time: 1.1768003 Nov 11 17:14:24.274118 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-797ce30a-3787-473b-9091-008e45d32534 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=d6e00c3820f4483e8ed58ea833622a06&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1580741 Nov 11 17:14:24.290347 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55580) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:24.328449 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b590cdd9-cd27-47e2-8218-a38be254f1ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a9fc3a30-9b05-48d5-8f9b-6d8870878664,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:24.396225 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a208d7eb-3daf-40b5-8ee8-fd5f829160bc tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:24.515828 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55590) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:24.690459 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-47353d0b-945e-4884-9d7a-d67f71f7b199 req-174b636c-6abf-44cb-8085-08f45a788770 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 210 time: 0.1668108 Nov 11 17:14:24.769081 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-cad12506-5639-41dd-9195-330b8a10ac3f admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=c1b1c9fcde6f43aebc661f303149f3e6&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2514584 Nov 11 17:14:24.771524 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55600) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:24.827887 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a208d7eb-3daf-40b5-8ee8-fd5f829160bc tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b335e191-2f61-448c-a461-eee2a31cb259,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:24.846059 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08374e94-6af9-4594-a1ea-925638c38b21', 'name': 'tempest-ServerRescueNegativeTestJSON-797046329-router', 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93'}], 'enable_snat': True}, 'gw_port_id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': 'ed26d137d98846b9b45708f7e581e9b0', 'gw_port': {'id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:79:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08374e94-6af9-4594-a1ea-925638c38b21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:12Z', 'updated_at': '2021-11-11T17:14:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '94af5a65-b91a-4134-9a23-8e8a8229d743', 'name': '', 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45', 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0', 'mac_address': 'fa:16:3e:38:00:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08374e94-6af9-4594-a1ea-925638c38b21', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:16Z', 'updated_at': '2021-11-11T17:14:23Z', 'revision_number': 4, 'project_id': 'ed26d137d98846b9b45708f7e581e9b0', 'subnets': [{'id': 'aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:24.893591 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55608) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:24.904891 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-860ce803-e9f8-4ff6-82f0-7d6801c10f7c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:24.922824 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ed23581e-f9a9-44f4-8033-47d62cad257e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:24.926804 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a208d7eb-3daf-40b5-8ee8-fd5f829160bc tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:24.936559 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55612) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:24.940787 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-a208d7eb-3daf-40b5-8ee8-fd5f829160bc tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.7921677 Nov 11 17:14:24.943471 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-c138288e-d0ba-4cc4-a7fd-8aaf684fe5ed tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Request body: {'security_group_rule': {'security_group_id': '0acab519-6858-46d7-8130-5f8ede58987f', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:24.972250 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51a55b5f-d2c2-49b8-b419-1a35ebfcf0c2 None None] The sync data for ids ['08374e94-6af9-4594-a1ea-925638c38b21'] in dv-cinder-694140-2-iscsi is: [{'id': '08374e94-6af9-4594-a1ea-925638c38b21', 'name': 'tempest-ServerRescueNegativeTestJSON-797046329-router', 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93'}], 'enable_snat': True}, 'gw_port_id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': 'ed26d137d98846b9b45708f7e581e9b0', 'gw_port': {'id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:79:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08374e94-6af9-4594-a1ea-925638c38b21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:12Z', 'updated_at': '2021-11-11T17:14:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '94af5a65-b91a-4134-9a23-8e8a8229d743', 'name': '', 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45', 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0', 'mac_address': 'fa:16:3e:38:00:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08374e94-6af9-4594-a1ea-925638c38b21', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:16Z', 'updated_at': '2021-11-11T17:14:23Z', 'revision_number': 4, 'project_id': 'ed26d137d98846b9b45708f7e581e9b0', 'subnets': [{'id': 'aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:14:25.034092 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ed23581e-f9a9-44f4-8033-47d62cad257e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:25.080975 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-860ce803-e9f8-4ff6-82f0-7d6801c10f7c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:25.201241 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c138288e-d0ba-4cc4-a7fd-8aaf684fe5ed tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:25.510772 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c138288e-d0ba-4cc4-a7fd-8aaf684fe5ed tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:25.510772 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5818c45-a4e2-4790-b573-a6fc3f484c1a req-24902d8d-40c0-432f-b2cc-910e69ace9e1 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:25.510772 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f5818c45-a4e2-4790-b573-a6fc3f484c1a req-24902d8d-40c0-432f-b2cc-910e69ace9e1 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 931 time: 0.0655434 Nov 11 17:14:25.512139 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device aa2fc75b-4ee8-4417-b781-eb1c551f1c43 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:14:25.512238 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fd585263-ae7c-46ac-bb91-f0e1daa4026d {{(pid=102323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:14:25.525800 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:25.545011 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f5818c45-a4e2-4790-b573-a6fc3f484c1a req-fb4cb375-3cbf-4c8d-b3f3-4ab049434060 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0813460 Nov 11 17:14:25.573136 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-1bdcc673-1703-4b89-9c7e-a16117458740 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:25.575360 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-1bdcc673-1703-4b89-9c7e-a16117458740 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/networks?id=983bda4c-112d-442d-b37a-387818bb1d45 HTTP/1.1" status: 200 len: 818 time: 0.3100166 Nov 11 17:14:25.602468 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port aa2fc75b-4ee8-4417-b781-eb1c551f1c43 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:25.603143 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:25.604922 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-1992e4bc-0d1f-4798-b8cc-2be0ec23cc47 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/quotas/ed26d137d98846b9b45708f7e581e9b0 HTTP/1.1" status: 200 len: 375 time: 0.0224674 Nov 11 17:14:25.682977 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-860ce803-e9f8-4ff6-82f0-7d6801c10f7c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:25.686177 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-860ce803-e9f8-4ff6-82f0-7d6801c10f7c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:25.687603 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-860ce803-e9f8-4ff6-82f0-7d6801c10f7c admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/fff2f5f2-0eb2-44b5-8aec-14b7279abcc5 HTTP/1.1" status: 204 len: 168 time: 1.3965201 Nov 11 17:14:25.699079 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-860ce803-e9f8-4ff6-82f0-7d6801c10f7c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fff2f5f2-0eb2-44b5-8aec-14b7279abcc5,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:25.739152 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-2301b179-54c0-422c-b82b-0237333801c9 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=ed26d137d98846b9b45708f7e581e9b0&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1331100 Nov 11 17:14:25.744935 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ed23581e-f9a9-44f4-8033-47d62cad257e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:25.756105 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ed23581e-f9a9-44f4-8033-47d62cad257e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:25.757836 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-ed23581e-f9a9-44f4-8033-47d62cad257e admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/0d940244-ff7b-46eb-93b2-92729444d524 HTTP/1.1" status: 204 len: 168 time: 0.9824035 Nov 11 17:14:25.777885 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.provisioning_blocks [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Transition to ACTIVE for port object fd585263-ae7c-46ac-bb91-f0e1daa4026d will not be triggered until provisioned by entity L2. {{(pid=102323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:14:25.797614 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c138288e-d0ba-4cc4-a7fd-8aaf684fe5ed tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:25.816720 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed23581e-f9a9-44f4-8033-47d62cad257e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0d940244-ff7b-46eb-93b2-92729444d524,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:25.874247 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:25.889569 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c138288e-d0ba-4cc4-a7fd-8aaf684fe5ed tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=034f9cb4-77db-4801-b333-7d0d56d1c19e,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:26.096267 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-739983d4-27f0-40a0-9f31-eec0b57bcb65 service neutron] 10.222.0.16 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3559294 Nov 11 17:14:26.118018 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a54dc43c-643a-4f15-835e-a93523df6419 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:26.120365 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Pushing event updated for resources: {'Port': ['ID=fd585263-ae7c-46ac-bb91-f0e1daa4026d,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:26.187463 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c138288e-d0ba-4cc4-a7fd-8aaf684fe5ed tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:26.192885 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-c138288e-d0ba-4cc4-a7fd-8aaf684fe5ed tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.2549868 Nov 11 17:14:26.193852 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55642) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:26.204023 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Request body: {'floatingip': {'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:26.339824 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for floatingip, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:26.503703 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-12dd9595-8896-415b-b92b-a27c9dc25206 service neutron] 10.222.0.16 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3746355 Nov 11 17:14:26.508945 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Attempting to bind port fd585263-ae7c-46ac-bb91-f0e1daa4026d on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:14:26.509358 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Attempting to bind port fd585263-ae7c-46ac-bb91-f0e1daa4026d by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '0a2ff661-8b92-4963-a90f-415ffdc06b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 532, 'network_id': 'dee85f4f-de83-4218-8f3b-9f48a95689a9'}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:14:26.509635 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Attempting to bind port fd585263-ae7c-46ac-bb91-f0e1daa4026d on network dee85f4f-de83-4218-8f3b-9f48a95689a9 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:14:26.610875 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Port fd585263-ae7c-46ac-bb91-f0e1daa4026d on network dee85f4f-de83-4218-8f3b-9f48a95689a9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:14:26.610875 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Attempting to bind port fd585263-ae7c-46ac-bb91-f0e1daa4026d on network dee85f4f-de83-4218-8f3b-9f48a95689a9 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:14:26.610875 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 14, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:14:26.610875 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Checking segment: {'id': '0a2ff661-8b92-4963-a90f-415ffdc06b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 532, 'network_id': 'dee85f4f-de83-4218-8f3b-9f48a95689a9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:14:26.610875 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Bound using segment: {'id': '0a2ff661-8b92-4963-a90f-415ffdc06b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 532, 'network_id': 'dee85f4f-de83-4218-8f3b-9f48a95689a9'} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:14:26.610875 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Bound port: fd585263-ae7c-46ac-bb91-f0e1daa4026d, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0a2ff661-8b92-4963-a90f-415ffdc06b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 532, 'network_id': 'dee85f4f-de83-4218-8f3b-9f48a95689a9'}}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:14:26.610875 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:26.648021 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a54dc43c-643a-4f15-835e-a93523df6419 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:26.784917 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] For port fd585263-ae7c-46ac-bb91-f0e1daa4026d, host hv-cinder-69414, cleared binding levels {{(pid=102323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:14:26.799072 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] For port fd585263-ae7c-46ac-bb91-f0e1daa4026d, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=fd585263-ae7c-46ac-bb91-f0e1daa4026d,segment=NetworkSegment(0a2ff661-8b92-4963-a90f-415ffdc06b18),segment_id=0a2ff661-8b92-4963-a90f-415ffdc06b18)] {{(pid=102323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:14:26.924200 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-501e95b2-e522-4fd4-9cdf-c76fc0e32131 req-1e048e9a-ad9d-4b27-8596-7e165f453ba4 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:26.926030 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-501e95b2-e522-4fd4-9cdf-c76fc0e32131 req-1e048e9a-ad9d-4b27-8596-7e165f453ba4 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 943 time: 0.1401274 Nov 11 17:14:26.939974 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a54dc43c-643a-4f15-835e-a93523df6419 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:27.040571 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-a54dc43c-643a-4f15-835e-a93523df6419 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=8986096a5559469682c7b91b20a2f70f&name=default HTTP/1.1" status: 200 len: 2996 time: 2.1455781 Nov 11 17:14:27.041243 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55668) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:27.047090 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:27.173674 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Pushing event updated for resources: {'Port': ['ID=fd585263-ae7c-46ac-bb91-f0e1daa4026d,revision_number=3']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:27.187725 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a54dc43c-643a-4f15-835e-a93523df6419 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=34b455de-057d-422b-9743-6e9be310e84b,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:27.275668 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:27.276465 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:27.278050 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-955270b8-0d79-4976-9013-6a0987e7f056 service neutron] 10.222.0.10 "PUT /v2.0/ports/fd585263-ae7c-46ac-bb91-f0e1daa4026d HTTP/1.1" status: 200 len: 1093 time: 4.6709509 Nov 11 17:14:27.279679 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a653c39c-4234-4aa6-bfbb-d867ce904738', 'tag': 'fd585263-ae7c-46ac-bb91-f0e1daa4026d'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:14:27.325895 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 94af5a65-b91a-4134-9a23-8e8a8229d743 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:14:27.330292 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fcdad6fb-a794-43d3-845d-34d074a18304 req-0e28e21b-9380-475d-a81a-9939545b77ed tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 210 time: 0.1503499 Nov 11 17:14:27.345797 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-501e95b2-e522-4fd4-9cdf-c76fc0e32131 req-2582d359-c101-45cf-8e63-309e284ecb42 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4077406 Nov 11 17:14:27.356133 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:27.434945 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e94c910b-5e22-4f01-8d3f-ee432dde62a5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:27.451744 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 94af5a65-b91a-4134-9a23-8e8a8229d743 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:27.452862 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:27.469673 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e94c910b-5e22-4f01-8d3f-ee432dde62a5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:27.658609 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:27.673776 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-ec19536c-2bb2-4259-9200-6186815a680f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:27.681403 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-ec19536c-2bb2-4259-9200-6186815a680f service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=cceb60931e5541518c468df87510c262&device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 1096 time: 0.1940560 Nov 11 17:14:27.738792 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] For port 94af5a65-b91a-4134-9a23-8e8a8229d743, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=94af5a65-b91a-4134-9a23-8e8a8229d743,segment=NetworkSegment(5eacaa77-ea76-482f-aec2-5adad8f8bde5),segment_id=5eacaa77-ea76-482f-aec2-5adad8f8bde5)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:27.743257 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Allocated IP 172.27.1.197 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/0fbd8885-6c03-4cfd-afb2-e1b3bcc53845) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:14:27.900762 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:28.053306 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e94c910b-5e22-4f01-8d3f-ee432dde62a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:28.053536 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:28.055579 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:28.056124 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e94c910b-5e22-4f01-8d3f-ee432dde62a5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:28.061308 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-e94c910b-5e22-4f01-8d3f-ee432dde62a5 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/34b455de-057d-422b-9743-6e9be310e84b HTTP/1.1" status: 204 len: 168 time: 1.0158122 Nov 11 17:14:28.098000 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e94c910b-5e22-4f01-8d3f-ee432dde62a5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=34b455de-057d-422b-9743-6e9be310e84b,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:28.118492 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event updated for resources: {'Port': ['ID=0fbd8885-6c03-4cfd-afb2-e1b3bcc53845,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:28.134107 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:14:28.145048 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:28.146962 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:14:28.297861 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Pushing event updated for resources: {'Port': ['ID=94af5a65-b91a-4134-9a23-8e8a8229d743,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:28.298943 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:28.408882 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-e57dec52-98e0-4c31-9f4e-7bf980c20a3d service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=fd585263-ae7c-46ac-bb91-f0e1daa4026d HTTP/1.1" status: 200 len: 217 time: 0.1069143 Nov 11 17:14:28.456388 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c76a050b-7867-42ed-8814-71ee8e4ecad3 req-1def548d-2bac-408e-9882-6cd070a3cfa1 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 210 time: 0.0493634 Nov 11 17:14:28.522609 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38e9548f-10d7-4a9a-bf37-182946012c77 req-1e4af557-a178-49d7-8a53-8ef58bf66eb4 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:28.529209 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-38e9548f-10d7-4a9a-bf37-182946012c77 req-1e4af557-a178-49d7-8a53-8ef58bf66eb4 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 943 time: 0.0665767 Nov 11 17:14:28.656836 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-38e9548f-10d7-4a9a-bf37-182946012c77 req-7e416b6c-3f63-4907-b104-06d7dcf19407 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1252341 Nov 11 17:14:28.675539 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:28.753858 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e0ad843-3153-4b19-b78e-6204a3f22243" -d '{"events": [{"name": "network-changed", "server_uuid": "a653c39c-4234-4aa6-bfbb-d867ce904738", "tag": "fd585263-ae7c-46ac-bb91-f0e1daa4026d"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:14:28.840863 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:28.950489 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:29.075648 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event updated for resources: {'Port': ['ID=0fbd8885-6c03-4cfd-afb2-e1b3bcc53845,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:29.185606 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:29.185865 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 94af5a65-b91a-4134-9a23-8e8a8229d743 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:14:29.204819 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 94af5a65-b91a-4134-9a23-8e8a8229d743 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:29.205636 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:29.485633 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:29.502896 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-098ee6b8-b6af-4022-9f8e-113f37dd2a8e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.3081768 Nov 11 17:14:29.600349 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:14:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c30140c7-251d-4ede-acdf-d3fd92c761e0 x-openstack-request-id: req-c30140c7-251d-4ede-acdf-d3fd92c761e0 {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:14:29.600653 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a653c39c-4234-4aa6-bfbb-d867ce904738", "tag": "fd585263-ae7c-46ac-bb91-f0e1daa4026d", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:14:29.600919 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-c30140c7-251d-4ede-acdf-d3fd92c761e0 {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:14:29.601391 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a653c39c-4234-4aa6-bfbb-d867ce904738', 'tag': 'fd585263-ae7c-46ac-bb91-f0e1daa4026d', 'status': 'completed', 'code': 200} Nov 11 17:14:29.665668 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3a0169de-2a0e-4d8d-8ec0-ab1dfb361748 req-415527ef-3772-4fa9-9128-24d5a4143978 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 210 time: 0.0779295 Nov 11 17:14:29.849086 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2016bde6-ef8f-4cc6-bba8-f7632e22983a req-4389c02f-4e88-4bfe-a26c-5ea20b236585 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:29.851340 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2016bde6-ef8f-4cc6-bba8-f7632e22983a req-4389c02f-4e88-4bfe-a26c-5ea20b236585 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 943 time: 0.0779026 Nov 11 17:14:29.925234 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2016bde6-ef8f-4cc6-bba8-f7632e22983a req-82c17b9f-fc85-4509-adc1-e4e71ce4a611 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0629230 Nov 11 17:14:30.147890 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-a14e90ca-89b1-4918-99ce-7598ee3223b7 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-securitygroup--717032521&fields=id&tenant_id=3a6e5bdc578b460ab28a883efa598f95 HTTP/1.1" status: 200 len: 267 time: 0.0591908 Nov 11 17:14:30.305908 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-0f048c95-4ca4-49c4-a01b-ff1b5f3e16aa tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:30.305908 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-0f048c95-4ca4-49c4-a01b-ff1b5f3e16aa tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/networks?id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f HTTP/1.1" status: 200 len: 816 time: 0.1451910 Nov 11 17:14:30.335440 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-499ff61f-3231-44dc-b9ed-ca75173249e4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/quotas/3a6e5bdc578b460ab28a883efa598f95 HTTP/1.1" status: 200 len: 375 time: 0.0277531 Nov 11 17:14:30.420490 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-d35d984a-bf16-470a-9cd0-0482517cd5d5 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=3a6e5bdc578b460ab28a883efa598f95&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0839567 Nov 11 17:14:30.555686 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-2a6cbcbe-86f1-486c-9da1-8e574be1b9bd service neutron] 10.222.0.16 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1182060 Nov 11 17:14:30.656852 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-c35e5d64-6314-4b3b-bd13-4e08e54c825b service neutron] 10.222.0.16 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0913899 Nov 11 17:14:30.800402 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1858593e-1756-4c67-9713-94ce1a59f5fd req-e01cec38-219d-431d-9015-cf14ff53d1eb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 210 time: 0.0399065 Nov 11 17:14:30.974622 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-5c646ded-9826-414c-be86-31948a9150f7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:31.145879 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-fe21e413-392d-4b0a-bda7-eaedade44df9 req-de0fd355-1791-46a5-a5da-d422b7dfecc2 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 210 time: 0.0973876 Nov 11 17:14:31.165635 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e45925c6-32b6-464a-8f8d-e49b064993bc req-65f07a1b-58cf-401c-a8d8-5f11369e8f01 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:31.167288 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e45925c6-32b6-464a-8f8d-e49b064993bc req-65f07a1b-58cf-401c-a8d8-5f11369e8f01 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 943 time: 0.1272051 Nov 11 17:14:31.250027 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e45925c6-32b6-464a-8f8d-e49b064993bc req-8177f87f-f1fe-4af9-a117-dc2f94f7f3ca tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0762115 Nov 11 17:14:31.931732 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-444150a1-5cbe-418e-a47c-727f93c81909 req-98e750ac-631d-4445-9183-3afa84ec98dc tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 210 time: 0.0428231 Nov 11 17:14:32.231508 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-10579d29-1a32-4e52-b58c-6a37051c511f req-98e76c5a-cbad-4753-a43f-63326cd9d0b3 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 210 time: 0.0476742 Nov 11 17:14:32.396831 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2413e696-ffd0-4877-80fa-9f115cca6d86 req-4f706565-7886-4b65-a862-fd0181c22e6e tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:32.398445 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2413e696-ffd0-4877-80fa-9f115cca6d86 req-4f706565-7886-4b65-a862-fd0181c22e6e tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 943 time: 0.0592034 Nov 11 17:14:32.486406 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2413e696-ffd0-4877-80fa-9f115cca6d86 req-fc160eb5-8c50-43e4-95b7-0311529cacf8 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0771716 Nov 11 17:14:33.051293 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-97769a64-6b35-4dea-a51f-98ad498007a0 req-2767e82d-c0a5-447d-8870-a27a530f1710 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 210 time: 0.0409629 Nov 11 17:14:33.359264 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-89cd18e2-d5fb-45d8-aeea-b362648d7028 req-489dd219-ca5f-4087-8e2d-642408f32fba tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 210 time: 0.0273836 Nov 11 17:14:33.442695 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-a19dafac-92b7-4b03-be1a-8ad4478b1b23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:33.444125 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-a19dafac-92b7-4b03-be1a-8ad4478b1b23 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=e608e66c-e895-4298-9bef-647d1d33f98e HTTP/1.1" status: 200 len: 852 time: 0.2271857 Nov 11 17:14:33.495660 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-c2f5dcfa-4a83-438a-8a0b-7639c738f909 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=dee85f4f-de83-4218-8f3b-9f48a95689a9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0441623 Nov 11 17:14:33.558581 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-88a15168-6845-40ce-8bf5-40e10a5cd3db None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:33.638364 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-1902835c-470c-439f-80f2-4ba6466ec8f4 service neutron] 10.222.0.10 "GET /v2.0/networks/dee85f4f-de83-4218-8f3b-9f48a95689a9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1340804 Nov 11 17:14:33.646886 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c249c5e-22c4-4708-9520-c68df6757d16 req-d09bcad3-e00a-4d56-8566-d31e51fe6ea7 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:33.656103 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1c249c5e-22c4-4708-9520-c68df6757d16 req-d09bcad3-e00a-4d56-8566-d31e51fe6ea7 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 943 time: 0.0936944 Nov 11 17:14:33.672906 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55900) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:33.763936 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1c249c5e-22c4-4708-9520-c68df6757d16 req-defdacfb-b197-4777-af0f-0b51487ff414 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1073747 Nov 11 17:14:33.783712 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ac4ff85b-10bd-4187-9fb9-e085345c259b req-b04c40d1-1eb9-4180-b396-6965793c1bc6 service neutron] 10.222.0.10 "GET /v2.0/networks/dee85f4f-de83-4218-8f3b-9f48a95689a9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1254084 Nov 11 17:14:33.809122 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e7cfd750-2992-4dfd-99db-5d69e30190ef admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:33.895994 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e7cfd750-2992-4dfd-99db-5d69e30190ef admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:33.972497 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0ad843-3153-4b19-b78e-6204a3f22243 req-2ea51b4c-df46-4b89-91ee-407a798c55d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:33.974040 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9e0ad843-3153-4b19-b78e-6204a3f22243 req-2ea51b4c-df46-4b89-91ee-407a798c55d2 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=cceb60931e5541518c468df87510c262&device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 1096 time: 0.0455916 Nov 11 17:14:33.984672 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e7cfd750-2992-4dfd-99db-5d69e30190ef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:34.086455 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-e7cfd750-2992-4dfd-99db-5d69e30190ef admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=e6b47d8591164518910db57d1c21bbc1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4072459 Nov 11 17:14:34.086455 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7cfd750-2992-4dfd-99db-5d69e30190ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6c3a04ec-1343-4348-b0f1-51df2eeceaa3,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:34.094564 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55918) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:34.151178 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a5205acb-aec5-4c1e-bce8-d7f76364ded0 req-ba5d83b2-0aa1-4288-bda2-77553ea218b5 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 210 time: 0.0273480 Nov 11 17:14:34.266606 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0ad843-3153-4b19-b78e-6204a3f22243 req-1dc445e3-2271-4bb1-94b4-b2d9bdda1ec1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:34.268144 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9e0ad843-3153-4b19-b78e-6204a3f22243 req-1dc445e3-2271-4bb1-94b4-b2d9bdda1ec1 service neutron] 10.222.0.10 "GET /v2.0/networks?id=dee85f4f-de83-4218-8f3b-9f48a95689a9 HTTP/1.1" status: 200 len: 913 time: 0.2755442 Nov 11 17:14:34.269185 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f812500e-d648-47f7-9de8-561a9a85636a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:34.328973 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9e0ad843-3153-4b19-b78e-6204a3f22243 req-f5f54606-0e2c-42b1-b1d7-c705bf81ef44 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=fd585263-ae7c-46ac-bb91-f0e1daa4026d HTTP/1.1" status: 200 len: 217 time: 0.0450053 Nov 11 17:14:34.341020 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f812500e-d648-47f7-9de8-561a9a85636a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:34.418329 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0ad843-3153-4b19-b78e-6204a3f22243 req-9e32bebd-68c4-46d1-840c-e6201a1675ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:34.419843 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9e0ad843-3153-4b19-b78e-6204a3f22243 req-9e32bebd-68c4-46d1-840c-e6201a1675ab service neutron] 10.222.0.10 "GET /v2.0/subnets?id=e608e66c-e895-4298-9bef-647d1d33f98e HTTP/1.1" status: 200 len: 852 time: 0.0811112 Nov 11 17:14:34.525663 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9e0ad843-3153-4b19-b78e-6204a3f22243 req-33276543-5fe9-437c-85ff-b384e3d2b0b1 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=dee85f4f-de83-4218-8f3b-9f48a95689a9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0920689 Nov 11 17:14:34.527675 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fdb84d64-a497-4c5d-b17e-15e9c3669ef8 req-aecac279-3555-4abf-9828-7fa91758d604 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 210 time: 0.0684366 Nov 11 17:14:34.614866 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f812500e-d648-47f7-9de8-561a9a85636a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:34.617936 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f812500e-d648-47f7-9de8-561a9a85636a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:34.619134 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-f812500e-d648-47f7-9de8-561a9a85636a admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/6c3a04ec-1343-4348-b0f1-51df2eeceaa3 HTTP/1.1" status: 204 len: 168 time: 0.5238373 Nov 11 17:14:34.635218 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f812500e-d648-47f7-9de8-561a9a85636a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6c3a04ec-1343-4348-b0f1-51df2eeceaa3,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:34.638703 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9e0ad843-3153-4b19-b78e-6204a3f22243 req-1e2e11df-ab13-4c2d-9653-3083f161d387 service neutron] 10.222.0.10 "GET /v2.0/networks/dee85f4f-de83-4218-8f3b-9f48a95689a9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1036911 Nov 11 17:14:34.671014 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:34.714078 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.10', 50534) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:34.788498 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9e0ad843-3153-4b19-b78e-6204a3f22243 req-99e7f695-66dd-47f1-936c-65b03df68375 service neutron] 10.222.0.10 "GET /v2.0/networks/dee85f4f-de83-4218-8f3b-9f48a95689a9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1395278 Nov 11 17:14:34.846941 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-74d8b064-7519-4e24-a287-97f00b6af698 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:34.848438 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-74d8b064-7519-4e24-a287-97f00b6af698 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.10 "GET /v2.0/networks?id=983bda4c-112d-442d-b37a-387818bb1d45 HTTP/1.1" status: 200 len: 818 time: 0.1330075 Nov 11 17:14:34.884071 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-5750ebda-e4ca-420b-82ee-145d0252539f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Request body: {'port': {'device_id': 'ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda', 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45', 'admin_state_up': True, 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:34.962327 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc7f301d-dfd8-4b5e-80f1-b2fe9d0cbd07 req-b87a91f3-17b3-4bb6-8721-cf6848abadfa tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:34.963891 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dc7f301d-dfd8-4b5e-80f1-b2fe9d0cbd07 req-b87a91f3-17b3-4bb6-8721-cf6848abadfa tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 943 time: 0.1100550 Nov 11 17:14:35.045008 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dc7f301d-dfd8-4b5e-80f1-b2fe9d0cbd07 req-4caf80c8-b5a1-4c27-9a03-5677aafbdf4c tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732694 Nov 11 17:14:35.167279 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-5750ebda-e4ca-420b-82ee-145d0252539f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Made reservation on behalf of ed26d137d98846b9b45708f7e581e9b0 for: {'port': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:14:35.170905 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-5750ebda-e4ca-420b-82ee-145d0252539f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:35.267348 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-97a8acaa-14d0-4566-98d4-08585426308a req-03f8c069-4e4b-43b6-b8ea-c7c919356256 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 210 time: 0.0374463 Nov 11 17:14:35.422748 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-5750ebda-e4ca-420b-82ee-145d0252539f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Allocated IP 172.20.0.9 (983bda4c-112d-442d-b37a-387818bb1d45/aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4/904b538c-2fcd-42a3-bc02-26c84d4d00cb) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:14:35.562816 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 55972) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:35.683720 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-700a3a37-8f8b-489c-b284-f2680034b7a1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:35.728761 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9a6419f3-cad8-4302-9429-fc7233516058 req-b1bb7135-a690-4fe7-92c6-c57f617ae311 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 210 time: 0.0463371 Nov 11 17:14:35.767815 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-0ed559c4-319f-4ae7-aefa-f0412f0130b8 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:35.769325 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-0ed559c4-319f-4ae7-aefa-f0412f0130b8 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.10 "GET /v2.0/networks?id=983bda4c-112d-442d-b37a-387818bb1d45 HTTP/1.1" status: 200 len: 818 time: 0.2757540 Nov 11 17:14:35.788588 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-738b0c3b-bc14-422c-a963-fe0d0a73b9f0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Request body: {'port': {'device_id': 'b317717e-d56a-49b7-9299-673bccd53ede', 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45', 'admin_state_up': True, 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:35.830397 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-5750ebda-e4ca-420b-82ee-145d0252539f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:35.915636 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-700a3a37-8f8b-489c-b284-f2680034b7a1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:35.962147 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-5750ebda-e4ca-420b-82ee-145d0252539f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:35.996530 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-738b0c3b-bc14-422c-a963-fe0d0a73b9f0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Made reservation on behalf of ed26d137d98846b9b45708f7e581e9b0 for: {'port': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:14:36.000467 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-738b0c3b-bc14-422c-a963-fe0d0a73b9f0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:36.003859 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-700a3a37-8f8b-489c-b284-f2680034b7a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:36.060019 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-5750ebda-e4ca-420b-82ee-145d0252539f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Network 983bda4c-112d-442d-b37a-387818bb1d45 is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:14:36.068022 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-700a3a37-8f8b-489c-b284-f2680034b7a1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=49457545-290b-4b4d-938e-d0ea427a3df6,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:36.074150 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-5750ebda-e4ca-420b-82ee-145d0252539f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:36.074798 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-700a3a37-8f8b-489c-b284-f2680034b7a1 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=22a764d11a6a4e1498e0a93e5fc2dc3c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5061057 Nov 11 17:14:36.082138 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 55990) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:36.092192 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-5750ebda-e4ca-420b-82ee-145d0252539f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:14:36.185841 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5750ebda-e4ca-420b-82ee-145d0252539f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Pushing event updated for resources: {'Port': ['ID=904b538c-2fcd-42a3-bc02-26c84d4d00cb,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:36.236040 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-738b0c3b-bc14-422c-a963-fe0d0a73b9f0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Allocated IP 172.20.0.2 (983bda4c-112d-442d-b37a-387818bb1d45/aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4/56aa9732-ebeb-41d7-ae07-03020a710285) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:14:36.287033 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.10', 50539) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:36.288881 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-5750ebda-e4ca-420b-82ee-145d0252539f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:36.289972 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-5750ebda-e4ca-420b-82ee-145d0252539f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:36.315008 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d84bf6c-4e5f-466d-9336-626b47de574e req-d980ea12-3cb3-49fd-90bb-52853ccec5b6 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:36.317177 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3d84bf6c-4e5f-466d-9336-626b47de574e req-d980ea12-3cb3-49fd-90bb-52853ccec5b6 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 943 time: 0.1383429 Nov 11 17:14:36.333455 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d02f003c-a2ab-42c0-ae63-382e1fd0d2d6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:36.344836 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:36.372241 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d02f003c-a2ab-42c0-ae63-382e1fd0d2d6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:36.400967 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3d84bf6c-4e5f-466d-9336-626b47de574e req-1675b224-fb3f-4139-9c6f-e26c9ef09e35 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0763371 Nov 11 17:14:36.454080 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-07d65ee8-fce3-471d-8388-1ee96a069d88 req-0e7c4049-0880-46df-aa5d-fed1f1644f4c tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 210 time: 0.0769708 Nov 11 17:14:36.514289 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-4214c71b-049f-454d-81a2-aee49f2b43d8 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:36.515844 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-4214c71b-049f-454d-81a2-aee49f2b43d8 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.10 "GET /v2.0/networks?id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f HTTP/1.1" status: 200 len: 816 time: 0.2270646 Nov 11 17:14:36.587519 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-738b0c3b-bc14-422c-a963-fe0d0a73b9f0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:36.637251 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-e8fabbc8-a483-4e5e-b5b9-acd92017527f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3a6e5bdc578b460ab28a883efa598f95 HTTP/1.1" status: 200 len: 379 time: 0.1104372 Nov 11 17:14:36.648228 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-92c88748-6e9f-405d-9268-7adc883267f4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Request body: {'port': {'device_id': '51c0e58c-1427-425f-ba26-73999c61ac11', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'admin_state_up': True, 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'security_groups': ['0acab519-6858-46d7-8130-5f8ede58987f']}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:36.760880 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-738b0c3b-bc14-422c-a963-fe0d0a73b9f0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:36.764965 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-5750ebda-e4ca-420b-82ee-145d0252539f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.8859437 Nov 11 17:14:36.766066 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d02f003c-a2ab-42c0-ae63-382e1fd0d2d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:36.772066 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d02f003c-a2ab-42c0-ae63-382e1fd0d2d6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:36.772066 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-d02f003c-a2ab-42c0-ae63-382e1fd0d2d6 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/49457545-290b-4b4d-938e-d0ea427a3df6 HTTP/1.1" status: 204 len: 168 time: 0.6803706 Nov 11 17:14:36.782561 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d02f003c-a2ab-42c0-ae63-382e1fd0d2d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=49457545-290b-4b4d-938e-d0ea427a3df6,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:36.864165 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4275f95c-1190-48ef-ad69-7bb7247d6782 req-f98164dc-df6b-4d4f-bde5-dada0603fc79 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 210 time: 0.0314231 Nov 11 17:14:37.020450 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-738b0c3b-bc14-422c-a963-fe0d0a73b9f0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Network 983bda4c-112d-442d-b37a-387818bb1d45 is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:14:37.021413 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:37.028920 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-738b0c3b-bc14-422c-a963-fe0d0a73b9f0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:37.030163 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-738b0c3b-bc14-422c-a963-fe0d0a73b9f0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:14:37.034767 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-738b0c3b-bc14-422c-a963-fe0d0a73b9f0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Pushing event updated for resources: {'Port': ['ID=56aa9732-ebeb-41d7-ae07-03020a710285,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:37.085578 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-738b0c3b-bc14-422c-a963-fe0d0a73b9f0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:37.087012 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-738b0c3b-bc14-422c-a963-fe0d0a73b9f0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:37.099091 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-92c88748-6e9f-405d-9268-7adc883267f4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Made reservation on behalf of 3a6e5bdc578b460ab28a883efa598f95 for: {'port': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:14:37.102652 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-92c88748-6e9f-405d-9268-7adc883267f4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:37.157222 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56024) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:37.194471 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-738b0c3b-bc14-422c-a963-fe0d0a73b9f0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.4128950 Nov 11 17:14:37.257034 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-92c88748-6e9f-405d-9268-7adc883267f4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Allocated IP 172.20.0.13 (4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f/1a4b11d7-2160-49c3-be78-265f0700c580/5de5065e-0ad8-4180-bd18-4e9927716a88) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:14:37.286346 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-56d13f4d-e3e1-4524-a55d-295ca377abdf admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:37.410022 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-92c88748-6e9f-405d-9268-7adc883267f4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:37.445335 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-56d13f4d-e3e1-4524-a55d-295ca377abdf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:37.527290 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2062f5a-e6bd-48f5-bcde-2ba6fae5dd0d req-b47c89ad-d37a-4f8f-a2a5-1b4c147835e2 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:37.529062 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d2062f5a-e6bd-48f5-bcde-2ba6fae5dd0d req-b47c89ad-d37a-4f8f-a2a5-1b4c147835e2 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 943 time: 0.0545599 Nov 11 17:14:37.576563 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e280d317-3ccb-4edb-8c63-a2f539247bb2 req-de582395-53d5-4a5d-94d2-0a82da12a540 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:37.583255 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e280d317-3ccb-4edb-8c63-a2f539247bb2 req-de582395-53d5-4a5d-94d2-0a82da12a540 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 931 time: 0.0512302 Nov 11 17:14:37.583486 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d2062f5a-e6bd-48f5-bcde-2ba6fae5dd0d req-d9193e37-e508-4e08-97dc-d61125b97b0a tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467250 Nov 11 17:14:37.613989 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-92c88748-6e9f-405d-9268-7adc883267f4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:37.614786 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-56d13f4d-e3e1-4524-a55d-295ca377abdf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:37.659275 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-92c88748-6e9f-405d-9268-7adc883267f4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:14:37.662372 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-92c88748-6e9f-405d-9268-7adc883267f4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:37.666874 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-92c88748-6e9f-405d-9268-7adc883267f4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:14:37.667109 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-56d13f4d-e3e1-4524-a55d-295ca377abdf admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=3887d29f52f04dbfb19e13cdfbbc27fb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5085680 Nov 11 17:14:37.673303 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 56046) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:37.682941 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e280d317-3ccb-4edb-8c63-a2f539247bb2 req-bd521a8f-02a6-4886-bfb4-fe3d2b3494dd tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0904360 Nov 11 17:14:37.684802 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56d13f4d-e3e1-4524-a55d-295ca377abdf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7dbe669d-388f-4685-a27f-84430f98cfb9,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:37.707929 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92c88748-6e9f-405d-9268-7adc883267f4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event updated for resources: {'Port': ['ID=5de5065e-0ad8-4180-bd18-4e9927716a88,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:37.778241 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-92c88748-6e9f-405d-9268-7adc883267f4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:37.778440 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-92c88748-6e9f-405d-9268-7adc883267f4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:37.826220 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f0b10438-8d34-43cd-996c-88732973648a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:37.833946 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f0b10438-8d34-43cd-996c-88732973648a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:37.919893 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-92c88748-6e9f-405d-9268-7adc883267f4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.2765026 Nov 11 17:14:37.987623 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57f273f4-8ec1-4918-86b1-fa430d351a7e req-5b5fde2f-f6a5-41c7-abc4-c6b635eb73a8 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:37.991871 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-57f273f4-8ec1-4918-86b1-fa430d351a7e req-5b5fde2f-f6a5-41c7-abc4-c6b635eb73a8 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 932 time: 0.0489180 Nov 11 17:14:38.012630 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f0b10438-8d34-43cd-996c-88732973648a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:38.015508 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f0b10438-8d34-43cd-996c-88732973648a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:38.019408 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-f0b10438-8d34-43cd-996c-88732973648a admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/7dbe669d-388f-4685-a27f-84430f98cfb9 HTTP/1.1" status: 204 len: 168 time: 0.3447261 Nov 11 17:14:38.029578 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-bd2d7648-869d-40f3-8bab-15ba4f7dce36 None None] Provisioning complete for port 5de5065e-0ad8-4180-bd18-4e9927716a88 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:38.031764 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bd2d7648-869d-40f3-8bab-15ba4f7dce36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:38.039864 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0b10438-8d34-43cd-996c-88732973648a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7dbe669d-388f-4685-a27f-84430f98cfb9,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:38.083690 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-57f273f4-8ec1-4918-86b1-fa430d351a7e req-8097274e-f0d9-43d1-a833-34ac420ce865 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0853081 Nov 11 17:14:38.091353 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-bd2d7648-869d-40f3-8bab-15ba4f7dce36 None None] Port 5de5065e-0ad8-4180-bd18-4e9927716a88 cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:14:38.696080 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff019d8f-3234-468a-a7e5-1586fc1fd6f9 req-3e851582-f9ea-4441-84bb-ffb110714988 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:38.697668 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ff019d8f-3234-468a-a7e5-1586fc1fd6f9 req-3e851582-f9ea-4441-84bb-ffb110714988 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 943 time: 0.0495267 Nov 11 17:14:38.757594 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ff019d8f-3234-468a-a7e5-1586fc1fd6f9 req-132cb555-2747-4da0-96bb-4e85b4a38254 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538254 Nov 11 17:14:38.807931 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bc0d3dc-59c5-4756-ab74-683d705bca09 req-aeada5d8-cf29-4332-bf94-e16441d47a78 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:38.809955 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6bc0d3dc-59c5-4756-ab74-683d705bca09 req-aeada5d8-cf29-4332-bf94-e16441d47a78 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 931 time: 0.0545969 Nov 11 17:14:38.822169 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56088) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:38.836714 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0d5eab29-584f-4f56-a597-ca7287fafac4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:38.871844 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6bc0d3dc-59c5-4756-ab74-683d705bca09 req-c8fc1591-aea7-49a3-8c60-e0188752d5cb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487359 Nov 11 17:14:38.930106 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0d5eab29-584f-4f56-a597-ca7287fafac4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:39.024876 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0d5eab29-584f-4f56-a597-ca7287fafac4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:39.065157 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d5eab29-584f-4f56-a597-ca7287fafac4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a98e96f-37c8-4999-a3b5-9fbea2bb1cf5,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:39.069418 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-0d5eab29-584f-4f56-a597-ca7287fafac4 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=428887c699b74f02ba8dcdadaae833a7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2461226 Nov 11 17:14:39.072051 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56104) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:39.133817 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9d06b24c-2bc7-45fe-a9e7-5e9a33908580 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:39.144370 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:14:39.161935 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9d06b24c-2bc7-45fe-a9e7-5e9a33908580 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:39.238333 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1ac8826-8a29-4283-8528-b45dec7a687f req-514b3920-335d-4e4e-8417-e8fbeea9921f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:39.239889 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f1ac8826-8a29-4283-8528-b45dec7a687f req-514b3920-335d-4e4e-8417-e8fbeea9921f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 932 time: 0.0758379 Nov 11 17:14:39.292542 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f1ac8826-8a29-4283-8528-b45dec7a687f req-a3238cde-1303-4058-9bae-76845f72c66b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455139 Nov 11 17:14:39.441977 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9d06b24c-2bc7-45fe-a9e7-5e9a33908580 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:39.444587 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9d06b24c-2bc7-45fe-a9e7-5e9a33908580 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:39.446534 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-9d06b24c-2bc7-45fe-a9e7-5e9a33908580 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/7a98e96f-37c8-4999-a3b5-9fbea2bb1cf5 HTTP/1.1" status: 204 len: 168 time: 0.3727691 Nov 11 17:14:39.454009 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d06b24c-2bc7-45fe-a9e7-5e9a33908580 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a98e96f-37c8-4999-a3b5-9fbea2bb1cf5,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:39.536922 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device fd585263-ae7c-46ac-bb91-f0e1daa4026d details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:14:39.540149 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Request body: {'port': {'device_id': 'ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:39.557181 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Request body: {'port': {'device_id': '51c0e58c-1427-425f-ba26-73999c61ac11', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:39.617840 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Request body: {'port': {'device_id': 'b317717e-d56a-49b7-9299-673bccd53ede', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:39.656899 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:39.716041 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port fd585263-ae7c-46ac-bb91-f0e1daa4026d, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=fd585263-ae7c-46ac-bb91-f0e1daa4026d,segment=NetworkSegment(0a2ff661-8b92-4963-a90f-415ffdc06b18),segment_id=0a2ff661-8b92-4963-a90f-415ffdc06b18)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:39.733508 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': 'fd585263-ae7c-46ac-bb91-f0e1daa4026d', 'network_id': 'dee85f4f-de83-4218-8f3b-9f48a95689a9', 'port_id': 'fd585263-ae7c-46ac-bb91-f0e1daa4026d', 'mac_address': 'fa:16:3e:67:97:70', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 532, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e608e66c-e895-4298-9bef-647d1d33f98e', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:14:39.820504 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:39.827158 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:39.831307 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:39.850922 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fd585263-ae7c-46ac-bb91-f0e1daa4026d {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:14:39.881076 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port fd585263-ae7c-46ac-bb91-f0e1daa4026d, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=fd585263-ae7c-46ac-bb91-f0e1daa4026d,segment=NetworkSegment(0a2ff661-8b92-4963-a90f-415ffdc06b18),segment_id=0a2ff661-8b92-4963-a90f-415ffdc06b18)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:40.087661 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:40.112456 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae241da5-5d3d-4a80-a504-683f5ec8ef34 req-f79e487b-3030-46fb-a078-57d2d30ad1d5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:40.114207 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ae241da5-5d3d-4a80-a504-683f5ec8ef34 req-f79e487b-3030-46fb-a078-57d2d30ad1d5 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 943 time: 0.2153242 Nov 11 17:14:40.162086 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 904b538c-2fcd-42a3-bc02-26c84d4d00cb {{(pid=102324) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:14:40.171055 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:40.205746 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=fd585263-ae7c-46ac-bb91-f0e1daa4026d,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:40.223801 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.provisioning_blocks [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Transition to ACTIVE for port object 904b538c-2fcd-42a3-bc02-26c84d4d00cb will not be triggered until provisioned by entity L2. {{(pid=102324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:14:40.250365 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7212d66a-1943-4067-ab0c-1c563bf9a956 req-3b286d89-40ea-4473-8122-2856a62738eb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:40.251803 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7212d66a-1943-4067-ab0c-1c563bf9a956 req-3b286d89-40ea-4473-8122-2856a62738eb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 931 time: 0.0772536 Nov 11 17:14:40.271073 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ae241da5-5d3d-4a80-a504-683f5ec8ef34 req-dee1380c-ecfc-48ad-a099-69d324281f19 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1432569 Nov 11 17:14:40.296849 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:40.343857 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7212d66a-1943-4067-ab0c-1c563bf9a956 req-7ed7ebdd-d8a3-48d1-9346-19d66a270cb3 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0806491 Nov 11 17:14:40.397291 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Pushing event updated for resources: {'Port': ['ID=904b538c-2fcd-42a3-bc02-26c84d4d00cb,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:40.420596 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['fd585263-ae7c-46ac-bb91-f0e1daa4026d'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:14:40.459059 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5de5065e-0ad8-4180-bd18-4e9927716a88 {{(pid=102323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:14:40.481168 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:40.517805 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Attempting to bind port 904b538c-2fcd-42a3-bc02-26c84d4d00cb on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:14:40.518359 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Attempting to bind port 904b538c-2fcd-42a3-bc02-26c84d4d00cb by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '5eacaa77-ea76-482f-aec2-5adad8f8bde5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 537, 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45'}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:14:40.518838 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Attempting to bind port 904b538c-2fcd-42a3-bc02-26c84d4d00cb on network 983bda4c-112d-442d-b37a-387818bb1d45 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:14:40.524802 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Port 904b538c-2fcd-42a3-bc02-26c84d4d00cb on network 983bda4c-112d-442d-b37a-387818bb1d45 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:14:40.525260 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Attempting to bind port 904b538c-2fcd-42a3-bc02-26c84d4d00cb on network 983bda4c-112d-442d-b37a-387818bb1d45 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:14:40.532650 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 14, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:14:40.533186 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Checking segment: {'id': '5eacaa77-ea76-482f-aec2-5adad8f8bde5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 537, 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:14:40.533806 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Bound using segment: {'id': '5eacaa77-ea76-482f-aec2-5adad8f8bde5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 537, 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45'} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:14:40.536064 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Bound port: 904b538c-2fcd-42a3-bc02-26c84d4d00cb, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5eacaa77-ea76-482f-aec2-5adad8f8bde5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 537, 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45'}}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:14:40.536064 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:40.536256 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a84156c2-391e-43a5-8c4d-92955be08217 req-e8c57d8d-3138-446f-abdf-462765f75908 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:40.538059 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a84156c2-391e-43a5-8c4d-92955be08217 req-e8c57d8d-3138-446f-abdf-462765f75908 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 932 time: 0.1187716 Nov 11 17:14:40.569010 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.provisioning_blocks [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Transition to ACTIVE for port object 5de5065e-0ad8-4180-bd18-4e9927716a88 will not be triggered until provisioned by entity L2. {{(pid=102323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:14:40.644474 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] For port 904b538c-2fcd-42a3-bc02-26c84d4d00cb, host hv-cinder-69414, cleared binding levels {{(pid=102324) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:14:40.655090 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] For port 904b538c-2fcd-42a3-bc02-26c84d4d00cb, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=904b538c-2fcd-42a3-bc02-26c84d4d00cb,segment=NetworkSegment(5eacaa77-ea76-482f-aec2-5adad8f8bde5),segment_id=5eacaa77-ea76-482f-aec2-5adad8f8bde5)] {{(pid=102324) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:14:40.684739 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a84156c2-391e-43a5-8c4d-92955be08217 req-35f81216-3bae-473c-8a8c-4d8a8d2b0fbe tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1248412 Nov 11 17:14:40.729061 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 56aa9732-ebeb-41d7-ae07-03020a710285 {{(pid=102323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:14:40.739602 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:40.756504 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:40.759457 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.provisioning_blocks [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Transition to ACTIVE for port object 56aa9732-ebeb-41d7-ae07-03020a710285 will not be triggered until provisioned by entity L2. {{(pid=102323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:14:40.802797 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:40.836796 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Pushing event updated for resources: {'Port': ['ID=5de5065e-0ad8-4180-bd18-4e9927716a88,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:40.840311 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:40.845437 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:40.850494 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] 10.222.0.10 "PUT /v2.0/ports/904b538c-2fcd-42a3-bc02-26c84d4d00cb HTTP/1.1" status: 200 len: 1093 time: 1.3228049 Nov 11 17:14:40.851239 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda', 'tag': '904b538c-2fcd-42a3-bc02-26c84d4d00cb'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:14:40.948332 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:41.041462 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54db0640-ffab-45f2-9795-db3aeac91e38 service neutron] Pushing event updated for resources: {'Port': ['ID=904b538c-2fcd-42a3-bc02-26c84d4d00cb,revision_number=3']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:41.078280 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Pushing event updated for resources: {'Port': ['ID=56aa9732-ebeb-41d7-ae07-03020a710285,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:41.172397 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Attempting to bind port 5de5065e-0ad8-4180-bd18-4e9927716a88 on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:14:41.172889 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Attempting to bind port 5de5065e-0ad8-4180-bd18-4e9927716a88 by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:14:41.173214 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Attempting to bind port 5de5065e-0ad8-4180-bd18-4e9927716a88 on network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:14:41.181533 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-37c49429-d16e-4c64-b4c3-fc861b9220d8" -d '{"events": [{"name": "network-changed", "server_uuid": "ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda", "tag": "904b538c-2fcd-42a3-bc02-26c84d4d00cb"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:14:41.210788 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Port 5de5065e-0ad8-4180-bd18-4e9927716a88 on network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:14:41.211650 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Attempting to bind port 5de5065e-0ad8-4180-bd18-4e9927716a88 on network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:14:41.214008 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-6b602fa9-9171-45eb-bf71-4ee4fb964f52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:41.215900 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-6b602fa9-9171-45eb-bf71-4ee4fb964f52 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ed26d137d98846b9b45708f7e581e9b0&device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 1096 time: 0.1483974 Nov 11 17:14:41.220615 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 14, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:14:41.220997 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Checking segment: {'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:14:41.227586 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Bound using segment: {'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:14:41.227586 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Bound port: 5de5065e-0ad8-4180-bd18-4e9927716a88, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'}}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:14:41.227586 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:41.303561 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Attempting to bind port 56aa9732-ebeb-41d7-ae07-03020a710285 on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:14:41.303901 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Attempting to bind port 56aa9732-ebeb-41d7-ae07-03020a710285 by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '5eacaa77-ea76-482f-aec2-5adad8f8bde5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 537, 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45'}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:14:41.304228 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Attempting to bind port 56aa9732-ebeb-41d7-ae07-03020a710285 on network 983bda4c-112d-442d-b37a-387818bb1d45 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:14:41.319267 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-51b230b4-c05e-4dc9-96e4-ebe6bc1d334e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=904b538c-2fcd-42a3-bc02-26c84d4d00cb HTTP/1.1" status: 200 len: 217 time: 0.0886452 Nov 11 17:14:41.320128 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Port 56aa9732-ebeb-41d7-ae07-03020a710285 on network 983bda4c-112d-442d-b37a-387818bb1d45 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:14:41.320640 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Attempting to bind port 56aa9732-ebeb-41d7-ae07-03020a710285 on network 983bda4c-112d-442d-b37a-387818bb1d45 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:14:41.361118 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] For port 5de5065e-0ad8-4180-bd18-4e9927716a88, host hv-cinder-69414, cleared binding levels {{(pid=102323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:14:41.364434 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] For port 5de5065e-0ad8-4180-bd18-4e9927716a88, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5de5065e-0ad8-4180-bd18-4e9927716a88,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:14:41.369640 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 14, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:14:41.369996 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Checking segment: {'id': '5eacaa77-ea76-482f-aec2-5adad8f8bde5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 537, 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:14:41.371378 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Bound using segment: {'id': '5eacaa77-ea76-482f-aec2-5adad8f8bde5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 537, 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45'} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:14:41.371916 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Bound port: 56aa9732-ebeb-41d7-ae07-03020a710285, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5eacaa77-ea76-482f-aec2-5adad8f8bde5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 537, 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45'}}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:14:41.372248 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:41.416439 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-9f53bb4e-8a1a-47aa-9278-a56ff9df8b8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:41.418438 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-9f53bb4e-8a1a-47aa-9278-a56ff9df8b8c service neutron] 10.222.0.10 "GET /v2.0/subnets?id=aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4 HTTP/1.1" status: 200 len: 858 time: 0.0906792 Nov 11 17:14:41.452837 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:41.510045 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:41.510748 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:41.510942 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:14:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0a0f8f97-ee40-4d70-a5c2-ed98afa8d6b2 x-openstack-request-id: req-0a0f8f97-ee40-4d70-a5c2-ed98afa8d6b2 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:14:41.511214 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda", "tag": "904b538c-2fcd-42a3-bc02-26c84d4d00cb", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:14:41.511594 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-0a0f8f97-ee40-4d70-a5c2-ed98afa8d6b2 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:14:41.512039 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda', 'tag': '904b538c-2fcd-42a3-bc02-26c84d4d00cb', 'status': 'completed', 'code': 200} Nov 11 17:14:41.512691 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] 10.222.0.10 "PUT /v2.0/ports/5de5065e-0ad8-4180-bd18-4e9927716a88 HTTP/1.1" status: 200 len: 1094 time: 1.9638448 Nov 11 17:14:41.513155 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '51c0e58c-1427-425f-ba26-73999c61ac11', 'tag': '5de5065e-0ad8-4180-bd18-4e9927716a88'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:14:41.515838 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f05d5fd8-3c76-4e38-a54f-55c93d70786a" -d '{"events": [{"name": "network-changed", "server_uuid": "51c0e58c-1427-425f-ba26-73999c61ac11", "tag": "5de5065e-0ad8-4180-bd18-4e9927716a88"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:14:41.542954 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] For port 56aa9732-ebeb-41d7-ae07-03020a710285, host hv-cinder-69414, cleared binding levels {{(pid=102323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:14:41.577429 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] For port 56aa9732-ebeb-41d7-ae07-03020a710285, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=56aa9732-ebeb-41d7-ae07-03020a710285,segment=NetworkSegment(5eacaa77-ea76-482f-aec2-5adad8f8bde5),segment_id=5eacaa77-ea76-482f-aec2-5adad8f8bde5)] {{(pid=102323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:14:41.602143 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-71288218-6498-4e23-a9a0-ebe589225da8 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=983bda4c-112d-442d-b37a-387818bb1d45&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1734548 Nov 11 17:14:41.614358 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-956c0ae4-e934-4746-a936-d9ff7a4450fe service neutron] Pushing event updated for resources: {'Port': ['ID=5de5065e-0ad8-4180-bd18-4e9927716a88,revision_number=3']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:41.692538 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:41.735682 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b706165-f99a-4094-884c-28cf0da0405d req-1343c043-2681-4895-872b-5d4d1c95ca6c tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:41.739031 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1b706165-f99a-4094-884c-28cf0da0405d req-1343c043-2681-4895-872b-5d4d1c95ca6c tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 944 time: 0.2429192 Nov 11 17:14:41.761140 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:41.761653 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:41.763110 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] 10.222.0.10 "PUT /v2.0/ports/56aa9732-ebeb-41d7-ae07-03020a710285 HTTP/1.1" status: 200 len: 1093 time: 2.2155299 Nov 11 17:14:41.785274 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-11f5d388-9767-4f1e-90bc-b2d1edd4ca8a service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1701455 Nov 11 17:14:41.789377 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e77a64a-f0ae-4827-ad60-a3daa8fcd386 req-4e966e6e-0019-479d-b416-16e8070d7ef3 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:41.790884 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2e77a64a-f0ae-4827-ad60-a3daa8fcd386 req-4e966e6e-0019-479d-b416-16e8070d7ef3 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 943 time: 0.2047279 Nov 11 17:14:41.803900 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-2b40e442-0927-4613-a651-b9266d48f90c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:41.805933 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-2b40e442-0927-4613-a651-b9266d48f90c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=3a6e5bdc578b460ab28a883efa598f95&device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 1097 time: 0.1371920 Nov 11 17:14:41.810955 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45219a6f-6501-4809-b198-4bf99a80ec84 service neutron] Pushing event updated for resources: {'Port': ['ID=56aa9732-ebeb-41d7-ae07-03020a710285,revision_number=3']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:41.844656 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1b706165-f99a-4094-884c-28cf0da0405d req-91eea6a0-f3a8-4cb0-843f-044c6f1b015a tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0929492 Nov 11 17:14:41.861788 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-012ab137-6750-4f31-a5b6-7d637877a252 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5de5065e-0ad8-4180-bd18-4e9927716a88 HTTP/1.1" status: 200 len: 217 time: 0.0478055 Nov 11 17:14:41.924855 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c75a894a-61a2-4ec3-9123-091ca0cd36ae req-380f6861-8319-49d3-8f2f-880491c26b56 service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1250222 Nov 11 17:14:41.965864 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2e77a64a-f0ae-4827-ad60-a3daa8fcd386 req-23102844-b39c-45f0-86d5-da2ce18f296a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1649323 Nov 11 17:14:41.979888 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-d4f9fb20-a0a0-4381-a4ef-b9e60ab1b701 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:41.981990 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-d4f9fb20-a0a0-4381-a4ef-b9e60ab1b701 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=1a4b11d7-2160-49c3-be78-265f0700c580 HTTP/1.1" status: 200 len: 855 time: 0.0957773 Nov 11 17:14:41.984779 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-65a6c163-56ce-4338-9823-6b306716efa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:41.986154 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-65a6c163-56ce-4338-9823-6b306716efa8 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ed26d137d98846b9b45708f7e581e9b0&device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 1096 time: 0.0991726 Nov 11 17:14:42.013878 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:14:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7b7a8c8d-766e-42a4-8166-6da7a2805b83 x-openstack-request-id: req-7b7a8c8d-766e-42a4-8166-6da7a2805b83 {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:14:42.013878 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "51c0e58c-1427-425f-ba26-73999c61ac11", "tag": "5de5065e-0ad8-4180-bd18-4e9927716a88", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:14:42.013878 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-7b7a8c8d-766e-42a4-8166-6da7a2805b83 {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:14:42.013878 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '51c0e58c-1427-425f-ba26-73999c61ac11', 'tag': '5de5065e-0ad8-4180-bd18-4e9927716a88', 'status': 'completed', 'code': 200} Nov 11 17:14:42.085466 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-ec727b53-b3b4-47cc-82f8-37d08a540c80 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=56aa9732-ebeb-41d7-ae07-03020a710285 HTTP/1.1" status: 200 len: 217 time: 0.0688710 Nov 11 17:14:42.116200 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device fd585263-ae7c-46ac-bb91-f0e1daa4026d up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:14:42.142565 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 56224) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:42.163293 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c49429-d16e-4c64-b4c3-fc861b9220d8 req-3ec38d63-8540-4408-8c3c-1a7074e7fdcb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:42.165655 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-37c49429-d16e-4c64-b4c3-fc861b9220d8 req-3ec38d63-8540-4408-8c3c-1a7074e7fdcb service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ed26d137d98846b9b45708f7e581e9b0&device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 1096 time: 0.0515389 Nov 11 17:14:42.167617 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-5e894886-e46d-4072-8512-314201e58f22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:42.169094 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-5e894886-e46d-4072-8512-314201e58f22 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1643109 Nov 11 17:14:42.188749 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1e80659-2348-42e0-be9f-8b2da640584e req-629d8cb3-bab5-43ab-92bc-54b5ec1d0d8a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:42.190276 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d1e80659-2348-42e0-be9f-8b2da640584e req-629d8cb3-bab5-43ab-92bc-54b5ec1d0d8a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.1506436 Nov 11 17:14:42.221531 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-c60f9c96-9d87-42e8-a13a-91655089eb71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:42.223717 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-c60f9c96-9d87-42e8-a13a-91655089eb71 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4 HTTP/1.1" status: 200 len: 858 time: 0.1179869 Nov 11 17:14:42.259039 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port fd585263-ae7c-46ac-bb91-f0e1daa4026d completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:14:42.264015 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port fd585263-ae7c-46ac-bb91-f0e1daa4026d triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:42.264593 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:42.296054 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-451e0dce-c4d1-4cb4-af91-793571431a85 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=983bda4c-112d-442d-b37a-387818bb1d45&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0571144 Nov 11 17:14:42.436275 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:42.485308 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a653c39c-4234-4aa6-bfbb-d867ce904738', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fd585263-ae7c-46ac-bb91-f0e1daa4026d'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:14:42.591578 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port fd585263-ae7c-46ac-bb91-f0e1daa4026d, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=fd585263-ae7c-46ac-bb91-f0e1daa4026d,segment=NetworkSegment(0a2ff661-8b92-4963-a90f-415ffdc06b18),segment_id=0a2ff661-8b92-4963-a90f-415ffdc06b18)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:42.626461 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d1e80659-2348-42e0-be9f-8b2da640584e req-23387f74-741f-4a55-8be5-390e069b484e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4251664 Nov 11 17:14:42.643099 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c49429-d16e-4c64-b4c3-fc861b9220d8 req-105ac850-2951-4327-8b8a-fb2bdadc8a0e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:42.644621 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-37c49429-d16e-4c64-b4c3-fc861b9220d8 req-105ac850-2951-4327-8b8a-fb2bdadc8a0e service neutron] 10.222.0.10 "GET /v2.0/networks?id=983bda4c-112d-442d-b37a-387818bb1d45 HTTP/1.1" status: 200 len: 919 time: 0.4634428 Nov 11 17:14:42.647604 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6f29bf53-84c2-4765-82dc-4a905a39495d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:42.660582 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-6b8b5888-a845-444c-b228-ca368ee6d91e service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4605298 Nov 11 17:14:42.682198 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:42.730398 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-37c49429-d16e-4c64-b4c3-fc861b9220d8 req-b380d7f4-a8c3-4846-b520-8b102b620142 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=904b538c-2fcd-42a3-bc02-26c84d4d00cb HTTP/1.1" status: 200 len: 217 time: 0.0774732 Nov 11 17:14:42.763781 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-93a417db-55b3-4962-8fb4-e95c78e0c59f service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4559364 Nov 11 17:14:42.776300 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=fd585263-ae7c-46ac-bb91-f0e1daa4026d,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:42.809145 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c49429-d16e-4c64-b4c3-fc861b9220d8 req-0f3e6062-9576-40d5-a8a0-d88aca5d9d56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:42.811728 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-37c49429-d16e-4c64-b4c3-fc861b9220d8 req-0f3e6062-9576-40d5-a8a0-d88aca5d9d56 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4 HTTP/1.1" status: 200 len: 858 time: 0.0709109 Nov 11 17:14:42.837219 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4f9698d8-2d5e-4666-bcb6-33a58feecd5a" -d '{"events": [{"server_uuid": "a653c39c-4234-4aa6-bfbb-d867ce904738", "name": "network-vif-plugged", "status": "completed", "tag": "fd585263-ae7c-46ac-bb91-f0e1daa4026d"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:14:42.861913 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-d1442147-bf93-45d0-a8d2-8deb1b49c1ed service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1953182 Nov 11 17:14:42.862458 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-37c49429-d16e-4c64-b4c3-fc861b9220d8 req-52c7a422-22be-4927-bca6-907d9ff6d5ff service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=983bda4c-112d-442d-b37a-387818bb1d45&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0417321 Nov 11 17:14:42.914154 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-82437a40-acb8-46f6-9422-fae0e0e0e1d4 req-3803bc3e-34d8-4580-9b39-6d7aadcb9e8e service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1396666 Nov 11 17:14:42.964375 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:14:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7e6d7b4d-e797-4457-ade2-51edee12da07 x-openstack-request-id: req-7e6d7b4d-e797-4457-ade2-51edee12da07 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:14:42.964701 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a653c39c-4234-4aa6-bfbb-d867ce904738", "name": "network-vif-plugged", "status": "completed", "tag": "fd585263-ae7c-46ac-bb91-f0e1daa4026d", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:14:42.964956 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-7e6d7b4d-e797-4457-ade2-51edee12da07 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:14:42.965408 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a653c39c-4234-4aa6-bfbb-d867ce904738', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fd585263-ae7c-46ac-bb91-f0e1daa4026d', 'code': 200} Nov 11 17:14:42.991160 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6f29bf53-84c2-4765-82dc-4a905a39495d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:43.016113 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4128b463-8a53-44bd-9ec5-48761f64d856 req-3670e6e4-666f-4b43-8c99-4cbb39a73ce8 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:43.019332 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-37c49429-d16e-4c64-b4c3-fc861b9220d8 req-73b4aae2-27b9-4f56-be52-43971de35f9d service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1413512 Nov 11 17:14:43.024462 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4128b463-8a53-44bd-9ec5-48761f64d856 req-3670e6e4-666f-4b43-8c99-4cbb39a73ce8 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 945 time: 0.0913970 Nov 11 17:14:43.132287 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4128b463-8a53-44bd-9ec5-48761f64d856 req-943e19a4-4771-4669-9bbc-5c87dc2ff843 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1069407 Nov 11 17:14:43.133842 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6f29bf53-84c2-4765-82dc-4a905a39495d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:43.176156 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f29bf53-84c2-4765-82dc-4a905a39495d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e5afdbc4-71f8-4b68-bcbf-6a6d8831f11c,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:43.193516 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09f468c1-f5ec-4e25-b772-e6442fe7b90d req-005cc314-7f2a-4f94-931f-ecb1cbafcae2 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:43.194860 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-09f468c1-f5ec-4e25-b772-e6442fe7b90d req-005cc314-7f2a-4f94-931f-ecb1cbafcae2 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 943 time: 0.0918934 Nov 11 17:14:43.202253 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-37c49429-d16e-4c64-b4c3-fc861b9220d8 req-8a8967cd-0bdc-4cf9-bacb-bcaee18c5ca6 service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1656542 Nov 11 17:14:43.227863 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-6f29bf53-84c2-4765-82dc-4a905a39495d admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=8b7dc78018744605a3377c1cc03a48d8&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0813427 Nov 11 17:14:43.233400 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 56264) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:43.278143 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05d5fd8-3c76-4e38-a54f-55c93d70786a req-54e9a91b-3241-4ff9-b24f-a53f0cd9b609 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:43.281652 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-09f468c1-f5ec-4e25-b772-e6442fe7b90d req-3b4c2303-0dc9-470b-b170-7db7d36d508c tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782611 Nov 11 17:14:43.284491 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f05d5fd8-3c76-4e38-a54f-55c93d70786a req-54e9a91b-3241-4ff9-b24f-a53f0cd9b609 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=3a6e5bdc578b460ab28a883efa598f95&device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 1097 time: 0.2227192 Nov 11 17:14:43.304348 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56266) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:43.337135 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ecd06457-ac7c-4ccc-b18e-9edb6b08650b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:43.395867 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ecd06457-ac7c-4ccc-b18e-9edb6b08650b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:43.427383 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-70206fd3-b1f2-4264-97b6-366bd359a632 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:43.437673 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05d5fd8-3c76-4e38-a54f-55c93d70786a req-e3023c8a-2437-47cb-881d-9a9469c3221e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:43.439197 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f05d5fd8-3c76-4e38-a54f-55c93d70786a req-e3023c8a-2437-47cb-881d-9a9469c3221e service neutron] 10.222.0.10 "GET /v2.0/networks?id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f HTTP/1.1" status: 200 len: 917 time: 0.1457376 Nov 11 17:14:43.485963 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f05d5fd8-3c76-4e38-a54f-55c93d70786a req-f3123f5c-28f1-4d56-97a3-a0ff145bdd7a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5de5065e-0ad8-4180-bd18-4e9927716a88 HTTP/1.1" status: 200 len: 217 time: 0.0383697 Nov 11 17:14:43.516337 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-437a3561-674a-4b94-af71-ed2ddff3ee64 req-567c5880-adbb-4a13-9a51-abf01b06c933 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:43.517801 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-437a3561-674a-4b94-af71-ed2ddff3ee64 req-567c5880-adbb-4a13-9a51-abf01b06c933 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 1098 time: 0.0779533 Nov 11 17:14:43.536024 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05d5fd8-3c76-4e38-a54f-55c93d70786a req-99d3acf8-f1b4-4f08-9a19-6ad7aa00cb74 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:43.537152 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-437a3561-674a-4b94-af71-ed2ddff3ee64 req-ceaa3ca0-5cf3-4052-8c3d-4c2e510bff44 service neutron] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:43.537479 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f05d5fd8-3c76-4e38-a54f-55c93d70786a req-99d3acf8-f1b4-4f08-9a19-6ad7aa00cb74 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=1a4b11d7-2160-49c3-be78-265f0700c580 HTTP/1.1" status: 200 len: 855 time: 0.0433662 Nov 11 17:14:43.573012 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ecd06457-ac7c-4ccc-b18e-9edb6b08650b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:43.577538 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ecd06457-ac7c-4ccc-b18e-9edb6b08650b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:43.581982 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-ecd06457-ac7c-4ccc-b18e-9edb6b08650b admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/e5afdbc4-71f8-4b68-bcbf-6a6d8831f11c HTTP/1.1" status: 204 len: 168 time: 0.3473263 Nov 11 17:14:43.598773 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecd06457-ac7c-4ccc-b18e-9edb6b08650b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5afdbc4-71f8-4b68-bcbf-6a6d8831f11c,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:43.623613 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05d5fd8-3c76-4e38-a54f-55c93d70786a req-6247cd1d-65f1-4e84-b41a-649611904936 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:43.648334 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f05d5fd8-3c76-4e38-a54f-55c93d70786a req-6247cd1d-65f1-4e84-b41a-649611904936 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0993724 Nov 11 17:14:43.667437 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-70206fd3-b1f2-4264-97b6-366bd359a632 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:43.669411 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-437a3561-674a-4b94-af71-ed2ddff3ee64 req-ceaa3ca0-5cf3-4052-8c3d-4c2e510bff44 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:43.745442 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-437a3561-674a-4b94-af71-ed2ddff3ee64 req-ceaa3ca0-5cf3-4052-8c3d-4c2e510bff44 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:43.756414 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-70206fd3-b1f2-4264-97b6-366bd359a632 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:43.844370 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-437a3561-674a-4b94-af71-ed2ddff3ee64 req-ceaa3ca0-5cf3-4052-8c3d-4c2e510bff44 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3189018 Nov 11 17:14:43.848214 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceaa3ca0-5cf3-4052-8c3d-4c2e510bff44 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=7fc1d4b9-24a2-4702-91a0-162e09aad460,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:43.858437 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-70206fd3-b1f2-4264-97b6-366bd359a632 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=f68c977e02ff45ec9758a3f614f48542&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5493822 Nov 11 17:14:43.859179 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 56284) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:43.878055 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-459802f7-2291-4272-894f-bb03cf305d23 req-39206baf-0d90-46b2-bed3-e6fe6261a98b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:43.879779 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-459802f7-2291-4272-894f-bb03cf305d23 req-39206baf-0d90-46b2-bed3-e6fe6261a98b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.1260638 Nov 11 17:14:43.906904 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70206fd3-b1f2-4264-97b6-366bd359a632 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae0c17b1-8895-46af-a5fa-be380ccf50fc,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:43.924676 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-578fabaf-9501-4d94-aa2e-465a3261ac04 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:43.942469 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-459802f7-2291-4272-894f-bb03cf305d23 req-29f2ee1e-c2b7-4cc0-b497-90267f2799ce tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0531719 Nov 11 17:14:43.955931 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-578fabaf-9501-4d94-aa2e-465a3261ac04 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:44.097072 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b317717e-d56a-49b7-9299-673bccd53ede', 'tag': '56aa9732-ebeb-41d7-ae07-03020a710285'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:14:44.097072 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-539712bd-df40-4f63-87af-93fd72d5ae5a" -d '{"events": [{"name": "network-changed", "server_uuid": "b317717e-d56a-49b7-9299-673bccd53ede", "tag": "56aa9732-ebeb-41d7-ae07-03020a710285"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:14:44.097072 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:14:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c1af4c9e-a338-4fef-b778-8cd49232bb7d x-openstack-request-id: req-c1af4c9e-a338-4fef-b778-8cd49232bb7d {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:14:44.097072 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b317717e-d56a-49b7-9299-673bccd53ede", "tag": "56aa9732-ebeb-41d7-ae07-03020a710285", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:14:44.097072 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-c1af4c9e-a338-4fef-b778-8cd49232bb7d {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:14:44.097072 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b317717e-d56a-49b7-9299-673bccd53ede', 'tag': '56aa9732-ebeb-41d7-ae07-03020a710285', 'status': 'completed', 'code': 200} Nov 11 17:14:44.259675 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31541ec2-89e0-402b-9c77-7d3c49a31f75 req-d8eef1ce-990b-432d-a7b4-0625bdc064ce tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:44.261175 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-31541ec2-89e0-402b-9c77-7d3c49a31f75 req-d8eef1ce-990b-432d-a7b4-0625bdc064ce tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 945 time: 0.0505610 Nov 11 17:14:44.340361 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-31541ec2-89e0-402b-9c77-7d3c49a31f75 req-e5a1bc3a-11c9-4e4a-ba7f-58a5dc57cdb1 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0606346 Nov 11 17:14:44.425958 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-907ccb1b-ce8b-429a-8faf-4e47134bce02 req-92f85164-b7c0-4553-a4da-a682336aa68b tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:44.428115 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-907ccb1b-ce8b-429a-8faf-4e47134bce02 req-92f85164-b7c0-4553-a4da-a682336aa68b tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 943 time: 0.0582476 Nov 11 17:14:44.493399 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-907ccb1b-ce8b-429a-8faf-4e47134bce02 req-ca9decba-8d3e-4e4c-b0cb-87a024ed49a2 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491157 Nov 11 17:14:44.751495 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 904b538c-2fcd-42a3-bc02-26c84d4d00cb details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:14:44.802337 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-578fabaf-9501-4d94-aa2e-465a3261ac04 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:44.805483 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-578fabaf-9501-4d94-aa2e-465a3261ac04 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:44.808526 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-578fabaf-9501-4d94-aa2e-465a3261ac04 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/ae0c17b1-8895-46af-a5fa-be380ccf50fc HTTP/1.1" status: 204 len: 168 time: 0.9466197 Nov 11 17:14:44.823775 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-578fabaf-9501-4d94-aa2e-465a3261ac04 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae0c17b1-8895-46af-a5fa-be380ccf50fc,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:44.881225 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 904b538c-2fcd-42a3-bc02-26c84d4d00cb, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=904b538c-2fcd-42a3-bc02-26c84d4d00cb,segment=NetworkSegment(5eacaa77-ea76-482f-aec2-5adad8f8bde5),segment_id=5eacaa77-ea76-482f-aec2-5adad8f8bde5)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:44.892589 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '904b538c-2fcd-42a3-bc02-26c84d4d00cb', 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45', 'port_id': '904b538c-2fcd-42a3-bc02-26c84d4d00cb', 'mac_address': 'fa:16:3e:18:4e:e2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 537, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:14:44.930680 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:44.943832 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 904b538c-2fcd-42a3-bc02-26c84d4d00cb {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:14:44.964826 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 904b538c-2fcd-42a3-bc02-26c84d4d00cb, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=904b538c-2fcd-42a3-bc02-26c84d4d00cb,segment=NetworkSegment(5eacaa77-ea76-482f-aec2-5adad8f8bde5),segment_id=5eacaa77-ea76-482f-aec2-5adad8f8bde5)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:45.080748 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5063cd50-ffe1-43b4-871f-de8fcc629ddd req-b256973b-63be-4c12-a51d-75190e6ac890 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:45.082209 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5063cd50-ffe1-43b4-871f-de8fcc629ddd req-b256973b-63be-4c12-a51d-75190e6ac890 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0553522 Nov 11 17:14:45.098705 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:45.132022 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5063cd50-ffe1-43b4-871f-de8fcc629ddd req-75717a67-19b5-4b6c-803a-00ba11c0f16a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430226 Nov 11 17:14:45.151114 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=904b538c-2fcd-42a3-bc02-26c84d4d00cb,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:45.181077 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 56336) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:45.194071 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-064512b0-f71a-400b-8dfe-10727f21b154 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:45.269880 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-064512b0-f71a-400b-8dfe-10727f21b154 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:45.423402 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-064512b0-f71a-400b-8dfe-10727f21b154 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:45.471826 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-064512b0-f71a-400b-8dfe-10727f21b154 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6c22a72c-60dd-4bfc-b217-92f30ab9b29e,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:45.479805 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-064512b0-f71a-400b-8dfe-10727f21b154 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=de64d1633f8c4ad39cf1bcc34734a546&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2974265 Nov 11 17:14:45.484552 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56350) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:45.488349 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f79b8c16-48f7-4884-a295-cb1f1083e434 req-372516a1-50b6-485d-877a-60251e2a98f7 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:45.489807 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f79b8c16-48f7-4884-a295-cb1f1083e434 req-372516a1-50b6-485d-877a-60251e2a98f7 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 945 time: 0.0932157 Nov 11 17:14:45.534320 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0eb5b7b1-5a8c-4a92-bcab-547227918e72 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:45.540032 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f79b8c16-48f7-4884-a295-cb1f1083e434 req-a41bb626-a653-4181-8969-f603483b352b tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429170 Nov 11 17:14:45.561070 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0eb5b7b1-5a8c-4a92-bcab-547227918e72 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:45.634630 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad563533-592a-403c-b8d5-bf55f3eca802 req-4328fde1-065a-4d61-8f3d-50d44ec47fde tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:45.636229 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ad563533-592a-403c-b8d5-bf55f3eca802 req-4328fde1-065a-4d61-8f3d-50d44ec47fde tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 943 time: 0.0667126 Nov 11 17:14:45.700598 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ad563533-592a-403c-b8d5-bf55f3eca802 req-70810515-4be8-437a-9c8d-426948aab84b tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0550215 Nov 11 17:14:45.733118 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0eb5b7b1-5a8c-4a92-bcab-547227918e72 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:45.735739 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0eb5b7b1-5a8c-4a92-bcab-547227918e72 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:45.739013 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-0eb5b7b1-5a8c-4a92-bcab-547227918e72 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/6c22a72c-60dd-4bfc-b217-92f30ab9b29e HTTP/1.1" status: 204 len: 168 time: 0.2550797 Nov 11 17:14:45.747766 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eb5b7b1-5a8c-4a92-bcab-547227918e72 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6c22a72c-60dd-4bfc-b217-92f30ab9b29e,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:46.266323 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dc7f097-69bf-4312-8f35-ceb62cdad552 req-9b42c5f3-a774-4785-9b67-c0433f1ecae6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:46.267857 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9dc7f097-69bf-4312-8f35-ceb62cdad552 req-9b42c5f3-a774-4785-9b67-c0433f1ecae6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0523462 Nov 11 17:14:46.315828 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9dc7f097-69bf-4312-8f35-ceb62cdad552 req-05ab8711-d9a8-40dc-8ec4-73bac7642833 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411000 Nov 11 17:14:46.673136 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58470d24-3f19-40d9-97f9-fc480a68fe1c req-4a54abb5-ec2b-4b18-be0f-481ce601d9e1 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:46.674756 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-58470d24-3f19-40d9-97f9-fc480a68fe1c req-4a54abb5-ec2b-4b18-be0f-481ce601d9e1 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 945 time: 0.0504317 Nov 11 17:14:46.691048 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 56400) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:46.749361 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-58470d24-3f19-40d9-97f9-fc480a68fe1c req-89312973-fa3f-4d6a-b1e8-ec52ffe0c97a tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683625 Nov 11 17:14:46.818899 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:46.832811 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a6ad99e1-732b-46c1-a47b-f9f62bbe2134 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:46.856980 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7231e79-64fa-4a65-8cfd-1080a5821c41 req-433dc5c4-c3b4-4854-b8c4-3d8d13709c09 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:46.858626 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a7231e79-64fa-4a65-8cfd-1080a5821c41 req-433dc5c4-c3b4-4854-b8c4-3d8d13709c09 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 943 time: 0.0797613 Nov 11 17:14:46.932759 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a7231e79-64fa-4a65-8cfd-1080a5821c41 req-12359b6b-66c7-490e-9700-6ae7afab9978 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658493 Nov 11 17:14:46.961076 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['904b538c-2fcd-42a3-bc02-26c84d4d00cb'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:14:46.970048 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a6ad99e1-732b-46c1-a47b-f9f62bbe2134 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:47.018187 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-539712bd-df40-4f63-87af-93fd72d5ae5a req-34129c91-c2e9-44c8-a470-3186471450f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:47.019847 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-539712bd-df40-4f63-87af-93fd72d5ae5a req-34129c91-c2e9-44c8-a470-3186471450f2 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ed26d137d98846b9b45708f7e581e9b0&device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 1096 time: 0.0435228 Nov 11 17:14:47.051289 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a6ad99e1-732b-46c1-a47b-f9f62bbe2134 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:47.072908 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f05d5fd8-3c76-4e38-a54f-55c93d70786a req-ef9f463f-74f6-41de-a9e3-e28e5bf73ba1 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1144893 Nov 11 17:14:47.140845 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-a6ad99e1-732b-46c1-a47b-f9f62bbe2134 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=c6d8fc3dee5747d7904bc78b9b0b23de&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4475880 Nov 11 17:14:47.144000 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6ad99e1-732b-46c1-a47b-f9f62bbe2134 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c334b22-9126-4b6a-88ed-249aed396aa5,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:47.146616 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 56418) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:47.164006 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-539712bd-df40-4f63-87af-93fd72d5ae5a req-7f0e4eec-5bec-47ad-9471-05c30a2a2a43 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:47.166123 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-539712bd-df40-4f63-87af-93fd72d5ae5a req-7f0e4eec-5bec-47ad-9471-05c30a2a2a43 service neutron] 10.222.0.10 "GET /v2.0/networks?id=983bda4c-112d-442d-b37a-387818bb1d45 HTTP/1.1" status: 200 len: 919 time: 0.1279118 Nov 11 17:14:47.218632 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-539712bd-df40-4f63-87af-93fd72d5ae5a req-90357c3b-66c3-4270-9eef-cf5f97bc3b11 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=56aa9732-ebeb-41d7-ae07-03020a710285 HTTP/1.1" status: 200 len: 217 time: 0.0412257 Nov 11 17:14:47.253885 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f05d5fd8-3c76-4e38-a54f-55c93d70786a req-20121fe1-1702-428c-87e2-fd6186e26b60 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1586397 Nov 11 17:14:47.256580 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a581edac-6194-48a7-87fe-cfede3be6a66 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:47.275618 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-539712bd-df40-4f63-87af-93fd72d5ae5a req-5020b46a-8deb-46b6-8d75-39ffcd65ee15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:47.277154 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-539712bd-df40-4f63-87af-93fd72d5ae5a req-5020b46a-8deb-46b6-8d75-39ffcd65ee15 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4 HTTP/1.1" status: 200 len: 858 time: 0.0443816 Nov 11 17:14:47.279466 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a581edac-6194-48a7-87fe-cfede3be6a66 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:47.312278 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-539712bd-df40-4f63-87af-93fd72d5ae5a req-c2e6367d-93f1-4bda-82e3-7b97db866f72 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=983bda4c-112d-442d-b37a-387818bb1d45&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0273991 Nov 11 17:14:47.431700 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-539712bd-df40-4f63-87af-93fd72d5ae5a req-ebba92bc-e5f2-489a-8e47-a714b23fca7e service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1117713 Nov 11 17:14:47.458527 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-880bf05d-bb32-439f-8817-05dddae2ea0b req-80280a39-fbee-4fc1-9fc0-d8d6ec3c5fd8 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:47.460032 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-880bf05d-bb32-439f-8817-05dddae2ea0b req-80280a39-fbee-4fc1-9fc0-d8d6ec3c5fd8 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0724418 Nov 11 17:14:47.557303 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-880bf05d-bb32-439f-8817-05dddae2ea0b req-6af10e77-eedd-43ec-8f3e-7ba77c8bd94f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0837026 Nov 11 17:14:47.572990 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-539712bd-df40-4f63-87af-93fd72d5ae5a req-958e0da1-0c49-4273-8990-2c0e6151ca5f service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1314235 Nov 11 17:14:47.584506 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a581edac-6194-48a7-87fe-cfede3be6a66 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:47.587712 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a581edac-6194-48a7-87fe-cfede3be6a66 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:47.589541 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-a581edac-6194-48a7-87fe-cfede3be6a66 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/0c334b22-9126-4b6a-88ed-249aed396aa5 HTTP/1.1" status: 204 len: 168 time: 0.4389091 Nov 11 17:14:47.596462 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a581edac-6194-48a7-87fe-cfede3be6a66 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c334b22-9126-4b6a-88ed-249aed396aa5,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:47.866747 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-211650e6-5459-40ad-8b76-f70f06ca48fc req-7e7dcdb9-ff9c-43b4-9729-aee2dd86448d tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:47.866747 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-211650e6-5459-40ad-8b76-f70f06ca48fc req-7e7dcdb9-ff9c-43b4-9729-aee2dd86448d tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 945 time: 0.0475326 Nov 11 17:14:47.917743 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-211650e6-5459-40ad-8b76-f70f06ca48fc req-25faabcb-f55e-4bd4-be58-0cbb89e89883 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454998 Nov 11 17:14:48.071590 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2074078e-9977-4bd0-8fba-d88dc32c5952 req-93a2259c-1c52-43ad-aebf-47e7bc643635 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:48.073389 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2074078e-9977-4bd0-8fba-d88dc32c5952 req-93a2259c-1c52-43ad-aebf-47e7bc643635 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 943 time: 0.0593691 Nov 11 17:14:48.141710 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2074078e-9977-4bd0-8fba-d88dc32c5952 req-cef0705e-aba9-4096-8531-70320bf94717 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620518 Nov 11 17:14:48.703211 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d1b014c-723b-4bed-93e5-80f5f0de65fa req-ba094dff-69ce-43d7-b0e6-7d51db53d80e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:48.707012 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6d1b014c-723b-4bed-93e5-80f5f0de65fa req-ba094dff-69ce-43d7-b0e6-7d51db53d80e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0674727 Nov 11 17:14:48.728703 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 5de5065e-0ad8-4180-bd18-4e9927716a88 details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:14:48.736322 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 904b538c-2fcd-42a3-bc02-26c84d4d00cb up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:14:48.761693 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6d1b014c-723b-4bed-93e5-80f5f0de65fa req-676d277e-471d-4a20-9a6f-623a2df335c1 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0500016 Nov 11 17:14:48.896943 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 5de5065e-0ad8-4180-bd18-4e9927716a88, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5de5065e-0ad8-4180-bd18-4e9927716a88,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:48.909257 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '5de5065e-0ad8-4180-bd18-4e9927716a88', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'port_id': '5de5065e-0ad8-4180-bd18-4e9927716a88', 'mac_address': 'fa:16:3e:0f:ef:ce', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 538, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:14:48.960666 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:48.980495 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5de5065e-0ad8-4180-bd18-4e9927716a88 {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:14:49.001944 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 5de5065e-0ad8-4180-bd18-4e9927716a88, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5de5065e-0ad8-4180-bd18-4e9927716a88,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:49.041432 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ff81d78-e0a3-4c85-b9fb-88199999cf2a req-db475135-3d8f-424d-a9d2-f21dca761ee2 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:49.042778 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3ff81d78-e0a3-4c85-b9fb-88199999cf2a req-db475135-3d8f-424d-a9d2-f21dca761ee2 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 945 time: 0.0491374 Nov 11 17:14:49.065458 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port 904b538c-2fcd-42a3-bc02-26c84d4d00cb completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:14:49.070624 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 904b538c-2fcd-42a3-bc02-26c84d4d00cb triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:49.071105 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:49.111143 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3ff81d78-e0a3-4c85-b9fb-88199999cf2a req-729d6090-a010-4ec6-9c92-1e3ec9997c00 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621564 Nov 11 17:14:49.128204 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:49.129106 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 56aa9732-ebeb-41d7-ae07-03020a710285 details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:14:49.254611 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=5de5065e-0ad8-4180-bd18-4e9927716a88,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:49.272437 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:49.290101 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56548) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:49.320395 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d8c385c-a8a5-49f1-8bbc-371134e2cfa4 req-0d027a2f-818b-4fd3-85bf-bb4270a445bb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:49.322466 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1d8c385c-a8a5-49f1-8bbc-371134e2cfa4 req-0d027a2f-818b-4fd3-85bf-bb4270a445bb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 943 time: 0.0592859 Nov 11 17:14:49.336500 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '904b538c-2fcd-42a3-bc02-26c84d4d00cb'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:14:49.338813 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5162b4d0-6d9d-4fa5-ad5f-3199398a155d" -d '{"events": [{"server_uuid": "ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda", "name": "network-vif-plugged", "status": "completed", "tag": "904b538c-2fcd-42a3-bc02-26c84d4d00cb"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:14:49.358941 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 904b538c-2fcd-42a3-bc02-26c84d4d00cb, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=904b538c-2fcd-42a3-bc02-26c84d4d00cb,segment=NetworkSegment(5eacaa77-ea76-482f-aec2-5adad8f8bde5),segment_id=5eacaa77-ea76-482f-aec2-5adad8f8bde5)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:49.375423 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 56aa9732-ebeb-41d7-ae07-03020a710285, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=56aa9732-ebeb-41d7-ae07-03020a710285,segment=NetworkSegment(5eacaa77-ea76-482f-aec2-5adad8f8bde5),segment_id=5eacaa77-ea76-482f-aec2-5adad8f8bde5)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:49.393297 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '56aa9732-ebeb-41d7-ae07-03020a710285', 'network_id': '983bda4c-112d-442d-b37a-387818bb1d45', 'port_id': '56aa9732-ebeb-41d7-ae07-03020a710285', 'mac_address': 'fa:16:3e:35:f8:1a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 537, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:14:49.398102 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:14:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6c5ffcdf-7f1e-45bd-a68c-97ba60195ab4 x-openstack-request-id: req-6c5ffcdf-7f1e-45bd-a68c-97ba60195ab4 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:14:49.398410 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda", "name": "network-vif-plugged", "status": "completed", "tag": "904b538c-2fcd-42a3-bc02-26c84d4d00cb", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:14:49.399260 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-6c5ffcdf-7f1e-45bd-a68c-97ba60195ab4 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:14:49.399651 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '904b538c-2fcd-42a3-bc02-26c84d4d00cb', 'code': 200} Nov 11 17:14:49.414967 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1d8c385c-a8a5-49f1-8bbc-371134e2cfa4 req-a812aacf-2903-445e-9171-21c38ab71363 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0853858 Nov 11 17:14:49.440731 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-debb03c7-62cb-4119-abf0-a48476d21183 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:49.446953 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:49.460044 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 56aa9732-ebeb-41d7-ae07-03020a710285 {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:14:49.480820 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 56aa9732-ebeb-41d7-ae07-03020a710285, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=56aa9732-ebeb-41d7-ae07-03020a710285,segment=NetworkSegment(5eacaa77-ea76-482f-aec2-5adad8f8bde5),segment_id=5eacaa77-ea76-482f-aec2-5adad8f8bde5)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:49.498892 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:49.519879 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-debb03c7-62cb-4119-abf0-a48476d21183 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:49.554430 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=904b538c-2fcd-42a3-bc02-26c84d4d00cb,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:49.619159 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:49.619331 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-debb03c7-62cb-4119-abf0-a48476d21183 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:49.662431 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-debb03c7-62cb-4119-abf0-a48476d21183 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b8776b4e-64bf-4642-9296-ce6a921e4f7d,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:49.668464 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-debb03c7-62cb-4119-abf0-a48476d21183 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=fd20499e38dc45c098708d04d4f8d6b2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3760490 Nov 11 17:14:49.670078 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 56556) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:49.676901 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=56aa9732-ebeb-41d7-ae07-03020a710285,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:49.724000 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5f3002b1-866a-4391-82a9-b6068dcdfb92 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:49.747819 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5f3002b1-866a-4391-82a9-b6068dcdfb92 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:49.785912 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8707381a-fa1f-44d3-9215-7fe43983830c req-e1648d20-3136-4b17-9c89-da87248885f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:49.788599 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8707381a-fa1f-44d3-9215-7fe43983830c req-e1648d20-3136-4b17-9c89-da87248885f5 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 1098 time: 0.0504482 Nov 11 17:14:49.841285 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8707381a-fa1f-44d3-9215-7fe43983830c req-e560c22b-be56-4ffc-a762-57249f02b817 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421946 Nov 11 17:14:49.897160 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b929ea0d-40e7-4112-929a-bc48f2209aec req-6c601c7e-debe-4844-900f-c7d1c45a023e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:49.898787 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b929ea0d-40e7-4112-929a-bc48f2209aec req-6c601c7e-debe-4844-900f-c7d1c45a023e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 945 time: 0.0610983 Nov 11 17:14:49.905868 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['56aa9732-ebeb-41d7-ae07-03020a710285'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:14:49.916304 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5f3002b1-866a-4391-82a9-b6068dcdfb92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:49.918975 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5f3002b1-866a-4391-82a9-b6068dcdfb92 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:49.924478 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-5f3002b1-866a-4391-82a9-b6068dcdfb92 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/b8776b4e-64bf-4642-9296-ce6a921e4f7d HTTP/1.1" status: 204 len: 168 time: 0.2488554 Nov 11 17:14:49.938509 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f3002b1-866a-4391-82a9-b6068dcdfb92 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b8776b4e-64bf-4642-9296-ce6a921e4f7d,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:49.959312 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['5de5065e-0ad8-4180-bd18-4e9927716a88'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:14:49.982483 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b929ea0d-40e7-4112-929a-bc48f2209aec req-6b52eda6-320d-4686-9078-7c0ce667c3b2 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0684483 Nov 11 17:14:50.537929 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27168028-46e6-4463-a75a-5cefe7c28ae5 req-6fec641e-ae6a-4705-8c1d-5fe43d52a67a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:50.539510 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-27168028-46e6-4463-a75a-5cefe7c28ae5 req-6fec641e-ae6a-4705-8c1d-5fe43d52a67a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 944 time: 0.0493965 Nov 11 17:14:50.596689 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-27168028-46e6-4463-a75a-5cefe7c28ae5 req-5b259d2c-3281-4ab1-8941-2896ebb1b5f9 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507886 Nov 11 17:14:50.894640 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 56604) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:50.909050 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6f9e05a8-f675-4d1c-a119-a65c8abcf8aa admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:50.993457 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6f9e05a8-f675-4d1c-a119-a65c8abcf8aa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:51.075866 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6f9e05a8-f675-4d1c-a119-a65c8abcf8aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:51.089368 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b79f1274-5e2c-4a55-923b-5e24f382c10f req-859aeef3-27c6-406e-b70d-8b911b17e402 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:51.090876 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b79f1274-5e2c-4a55-923b-5e24f382c10f req-859aeef3-27c6-406e-b70d-8b911b17e402 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 945 time: 0.0490096 Nov 11 17:14:51.114088 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-6f9e05a8-f675-4d1c-a119-a65c8abcf8aa admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=c236277d76dc48d5856d5316bbc30ca9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2182186 Nov 11 17:14:51.115062 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f9e05a8-f675-4d1c-a119-a65c8abcf8aa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f19a2499-c973-4873-9a23-392c07e1d094,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:51.117956 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 56612) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:51.153695 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b79f1274-5e2c-4a55-923b-5e24f382c10f req-ced1b1c9-802a-4958-8065-51f6a3eda90f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0565975 Nov 11 17:14:51.168514 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c23f357b-4d5a-4a74-af5e-8b07ee2b9d16 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:51.191922 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c23f357b-4d5a-4a74-af5e-8b07ee2b9d16 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:51.344517 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c23f357b-4d5a-4a74-af5e-8b07ee2b9d16 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:51.347177 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c23f357b-4d5a-4a74-af5e-8b07ee2b9d16 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:51.348358 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-c23f357b-4d5a-4a74-af5e-8b07ee2b9d16 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/f19a2499-c973-4873-9a23-392c07e1d094 HTTP/1.1" status: 204 len: 168 time: 0.2294841 Nov 11 17:14:51.358617 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c23f357b-4d5a-4a74-af5e-8b07ee2b9d16 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f19a2499-c973-4873-9a23-392c07e1d094,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:51.715724 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10529880-1b6f-48f2-96e8-7d30754803b1 req-18883e7f-a6db-423b-a58b-fac2b92701d0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:51.717293 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-10529880-1b6f-48f2-96e8-7d30754803b1 req-18883e7f-a6db-423b-a58b-fac2b92701d0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 944 time: 0.0551043 Nov 11 17:14:51.767626 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-10529880-1b6f-48f2-96e8-7d30754803b1 req-6487c3d6-465a-48bd-999f-70a5ee9b91ea tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426939 Nov 11 17:14:52.275790 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-971fa1ea-edfd-43f5-872d-492ed0838212 req-aa8ee840-10d1-46a6-8b16-a9bf414c0059 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:52.277237 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-971fa1ea-edfd-43f5-872d-492ed0838212 req-aa8ee840-10d1-46a6-8b16-a9bf414c0059 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 945 time: 0.0477681 Nov 11 17:14:52.324113 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-971fa1ea-edfd-43f5-872d-492ed0838212 req-a33b1c05-492e-44b3-889f-e084362e5fa3 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408478 Nov 11 17:14:52.885183 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77171f62-2272-4c36-81d6-9cda55ba6b14 req-ebc04b42-ada8-481c-b50c-18c882d12496 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:52.886657 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-77171f62-2272-4c36-81d6-9cda55ba6b14 req-ebc04b42-ada8-481c-b50c-18c882d12496 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 944 time: 0.0518918 Nov 11 17:14:52.935760 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-77171f62-2272-4c36-81d6-9cda55ba6b14 req-5d882b4c-9f0c-45dc-8834-7277221af98c tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431609 Nov 11 17:14:52.959256 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 5de5065e-0ad8-4180-bd18-4e9927716a88 up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:14:53.098838 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port 5de5065e-0ad8-4180-bd18-4e9927716a88 completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:14:53.103513 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 5de5065e-0ad8-4180-bd18-4e9927716a88 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:53.103885 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:53.183900 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:53.206552 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '51c0e58c-1427-425f-ba26-73999c61ac11', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5de5065e-0ad8-4180-bd18-4e9927716a88'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:14:53.208743 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ceb6b41a-f896-4357-ad2b-a3fd8222ff0d" -d '{"events": [{"server_uuid": "51c0e58c-1427-425f-ba26-73999c61ac11", "name": "network-vif-plugged", "status": "completed", "tag": "5de5065e-0ad8-4180-bd18-4e9927716a88"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:14:53.222371 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 5de5065e-0ad8-4180-bd18-4e9927716a88, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5de5065e-0ad8-4180-bd18-4e9927716a88,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:53.245832 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:14:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de35e3c4-6c04-42cb-af2f-6253c25f2e6d x-openstack-request-id: req-de35e3c4-6c04-42cb-af2f-6253c25f2e6d {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:14:53.246138 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "51c0e58c-1427-425f-ba26-73999c61ac11", "name": "network-vif-plugged", "status": "completed", "tag": "5de5065e-0ad8-4180-bd18-4e9927716a88", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:14:53.246384 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-de35e3c4-6c04-42cb-af2f-6253c25f2e6d {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:14:53.246796 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '51c0e58c-1427-425f-ba26-73999c61ac11', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5de5065e-0ad8-4180-bd18-4e9927716a88', 'code': 200} Nov 11 17:14:53.377995 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:53.394439 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 56aa9732-ebeb-41d7-ae07-03020a710285 up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:14:53.464116 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=5de5065e-0ad8-4180-bd18-4e9927716a88,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:53.466187 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c7a5935-5b08-4924-a3ee-2dce1b77b28f req-b2a5fa01-619c-427a-ba80-b7952da876b6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:53.466187 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8c7a5935-5b08-4924-a3ee-2dce1b77b28f req-b2a5fa01-619c-427a-ba80-b7952da876b6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.0561569 Nov 11 17:14:53.518609 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8c7a5935-5b08-4924-a3ee-2dce1b77b28f req-34ed4948-475c-4b53-b62e-fccfd927fe77 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436959 Nov 11 17:14:53.555643 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port 56aa9732-ebeb-41d7-ae07-03020a710285 completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:14:53.563632 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 56aa9732-ebeb-41d7-ae07-03020a710285 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:14:53.563632 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:53.747122 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:53.778743 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 56aa9732-ebeb-41d7-ae07-03020a710285, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=56aa9732-ebeb-41d7-ae07-03020a710285,segment=NetworkSegment(5eacaa77-ea76-482f-aec2-5adad8f8bde5),segment_id=5eacaa77-ea76-482f-aec2-5adad8f8bde5)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:14:53.875869 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:53.918751 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 56704) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:53.922964 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=56aa9732-ebeb-41d7-ae07-03020a710285,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:54.069000 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-2096e819-3871-423c-92d6-59285f2b5311 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:54.125077 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-357511c8-7102-4404-98f9-a188ce152761 req-80406592-2a96-4aac-b14b-e67757bf8f23 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:54.132418 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-357511c8-7102-4404-98f9-a188ce152761 req-80406592-2a96-4aac-b14b-e67757bf8f23 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.1021245 Nov 11 17:14:54.209847 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-357511c8-7102-4404-98f9-a188ce152761 req-0480e695-92b9-4e5f-8382-4e6799c71525 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0763893 Nov 11 17:14:54.235482 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-2096e819-3871-423c-92d6-59285f2b5311 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:54.350236 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-2096e819-3871-423c-92d6-59285f2b5311 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:54.389343 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-2096e819-3871-423c-92d6-59285f2b5311 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=4eea3ff8eb1642b18b640e8f86b34616&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4692822 Nov 11 17:14:54.390310 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2096e819-3871-423c-92d6-59285f2b5311 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c4756d3-2275-4216-889a-1884f9c04d82,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:54.392404 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56720) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:54.458950 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-095f2d60-062b-4431-b62d-861916272271 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:54.510231 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-095f2d60-062b-4431-b62d-861916272271 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:54.548861 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d002226-c155-4cc9-9be8-c40ebdc9f751 req-3a1f2c16-2029-4427-9185-f3e00c423405 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:54.550401 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3d002226-c155-4cc9-9be8-c40ebdc9f751 req-3a1f2c16-2029-4427-9185-f3e00c423405 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 1099 time: 0.0765471 Nov 11 17:14:54.603855 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3d002226-c155-4cc9-9be8-c40ebdc9f751 req-dd9b0351-16a9-41e7-b3fe-2cb0d5ae17e7 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435381 Nov 11 17:14:54.639743 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9463c61e-01b8-41a1-8002-db5dfab94d3c req-6edcbb6b-5ffd-4d25-bd20-9dab549ddf21 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:54.641329 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9463c61e-01b8-41a1-8002-db5dfab94d3c req-6edcbb6b-5ffd-4d25-bd20-9dab549ddf21 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.0489085 Nov 11 17:14:54.681938 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-095f2d60-062b-4431-b62d-861916272271 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:54.684606 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-095f2d60-062b-4431-b62d-861916272271 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:54.685741 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-095f2d60-062b-4431-b62d-861916272271 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/0c4756d3-2275-4216-889a-1884f9c04d82 HTTP/1.1" status: 204 len: 168 time: 0.2921135 Nov 11 17:14:54.695357 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-095f2d60-062b-4431-b62d-861916272271 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c4756d3-2275-4216-889a-1884f9c04d82,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:54.706989 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9463c61e-01b8-41a1-8002-db5dfab94d3c req-29d0afc2-99f3-41a2-9e10-b3562556f3fb tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0596061 Nov 11 17:14:55.250279 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b317717e-d56a-49b7-9299-673bccd53ede', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '56aa9732-ebeb-41d7-ae07-03020a710285'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:14:55.250279 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e9af7b92-9e75-4370-ad19-b30fe0ba7360" -d '{"events": [{"server_uuid": "b317717e-d56a-49b7-9299-673bccd53ede", "name": "network-vif-plugged", "status": "completed", "tag": "56aa9732-ebeb-41d7-ae07-03020a710285"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:14:55.298171 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:14:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-414c4f83-3b00-4524-a761-8efb978f6acb x-openstack-request-id: req-414c4f83-3b00-4524-a761-8efb978f6acb {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:14:55.298486 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b317717e-d56a-49b7-9299-673bccd53ede", "name": "network-vif-plugged", "status": "completed", "tag": "56aa9732-ebeb-41d7-ae07-03020a710285", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:14:55.298775 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-414c4f83-3b00-4524-a761-8efb978f6acb {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:14:55.299158 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b317717e-d56a-49b7-9299-673bccd53ede', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '56aa9732-ebeb-41d7-ae07-03020a710285', 'code': 200} Nov 11 17:14:55.335172 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-462a9190-831b-4d39-bbd4-88d49f402304 req-efd90760-f95f-43c1-81ae-1023aaabc786 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:55.338493 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-462a9190-831b-4d39-bbd4-88d49f402304 req-efd90760-f95f-43c1-81ae-1023aaabc786 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0532818 Nov 11 17:14:55.385612 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-462a9190-831b-4d39-bbd4-88d49f402304 req-275089e7-8447-48e2-96db-7e7f123864da tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426590 Nov 11 17:14:55.459230 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56762) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:55.472534 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3b26ee88-7dd7-4334-9fba-4447194ff8fe admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:55.558375 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3b26ee88-7dd7-4334-9fba-4447194ff8fe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:55.704413 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56770) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:55.733424 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3b26ee88-7dd7-4334-9fba-4447194ff8fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:55.768403 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b26ee88-7dd7-4334-9fba-4447194ff8fe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a4c2c254-3d4e-4d62-987a-2bb804e950f1,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:55.830036 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-3b26ee88-7dd7-4334-9fba-4447194ff8fe admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=7d99c707d6024780a89fa8da013a8ead&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3696117 Nov 11 17:14:55.833088 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 56776) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:55.898094 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b97ff366-e970-4152-a0cf-b7f0a1954958 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:55.899336 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5644aa57-9fd4-42d4-8a10-372627df18c2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:55.919414 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44136eae-ce54-4861-9a6c-c3d656db5073 req-d9b0b381-61dc-41ed-ab87-55abe4cd2e7b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:55.919750 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b97ff366-e970-4152-a0cf-b7f0a1954958 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:55.920939 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-44136eae-ce54-4861-9a6c-c3d656db5073 req-d9b0b381-61dc-41ed-ab87-55abe4cd2e7b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.1092851 Nov 11 17:14:55.948558 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a53a2176-9a30-466a-8691-659e34a6ac50 req-ed848578-ef30-44a1-a26d-782995dcd038 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:55.950306 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a53a2176-9a30-466a-8691-659e34a6ac50 req-ed848578-ef30-44a1-a26d-782995dcd038 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 1098 time: 0.1050756 Nov 11 17:14:56.022420 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-44136eae-ce54-4861-9a6c-c3d656db5073 req-95cf3d30-e2dd-466f-8909-feeb1f13bce6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0931923 Nov 11 17:14:56.036242 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b97ff366-e970-4152-a0cf-b7f0a1954958 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:56.038837 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b97ff366-e970-4152-a0cf-b7f0a1954958 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:56.040209 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-b97ff366-e970-4152-a0cf-b7f0a1954958 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/a4c2c254-3d4e-4d62-987a-2bb804e950f1 HTTP/1.1" status: 204 len: 168 time: 0.2059190 Nov 11 17:14:56.048578 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b97ff366-e970-4152-a0cf-b7f0a1954958 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a4c2c254-3d4e-4d62-987a-2bb804e950f1,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:56.062422 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a53a2176-9a30-466a-8691-659e34a6ac50 req-15b80538-3d04-45c4-a409-2371d9ff8f8a service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0927587 Nov 11 17:14:56.089358 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5644aa57-9fd4-42d4-8a10-372627df18c2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:56.180588 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5644aa57-9fd4-42d4-8a10-372627df18c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:56.226202 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-5644aa57-9fd4-42d4-8a10-372627df18c2 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=055e07cd619b4942b18ebc536afef402&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5173433 Nov 11 17:14:56.226202 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5644aa57-9fd4-42d4-8a10-372627df18c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4701063c-34d1-47e6-8c34-a91a727be02f,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:56.226372 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56786) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:56.288201 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b2191f0d-00b9-4c10-b9e1-7cd769d35c44 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:56.322833 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b2191f0d-00b9-4c10-b9e1-7cd769d35c44 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:56.487648 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b2191f0d-00b9-4c10-b9e1-7cd769d35c44 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:56.490164 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b2191f0d-00b9-4c10-b9e1-7cd769d35c44 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:56.494960 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-b2191f0d-00b9-4c10-b9e1-7cd769d35c44 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/4701063c-34d1-47e6-8c34-a91a727be02f HTTP/1.1" status: 204 len: 168 time: 0.2674792 Nov 11 17:14:56.504252 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2191f0d-00b9-4c10-b9e1-7cd769d35c44 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4701063c-34d1-47e6-8c34-a91a727be02f,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:56.529147 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af11dbb2-2f0c-4943-a007-e7205b5eb900 req-2f634b57-e471-4b17-91fc-f357b8933b71 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:56.530798 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-af11dbb2-2f0c-4943-a007-e7205b5eb900 req-2f634b57-e471-4b17-91fc-f357b8933b71 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0630686 Nov 11 17:14:56.585336 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-af11dbb2-2f0c-4943-a007-e7205b5eb900 req-c905a884-a17e-40c9-9421-520b7575f2cd tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486126 Nov 11 17:14:57.141057 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3972ac91-c3d6-492d-b31f-e13908911645 req-0356f914-4425-425f-8230-e0e90961230b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:57.142479 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3972ac91-c3d6-492d-b31f-e13908911645 req-0356f914-4425-425f-8230-e0e90961230b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.0511394 Nov 11 17:14:57.203306 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3972ac91-c3d6-492d-b31f-e13908911645 req-54e521a5-84ca-4955-bf2f-392d625d33e2 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0548139 Nov 11 17:14:57.303788 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56834) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:57.411196 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15fdfcb5-77a3-4884-9840-201de804f1ec req-3a93c379-d5af-422f-b3b9-8e8a7d637651 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:57.412756 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-15fdfcb5-77a3-4884-9840-201de804f1ec req-3a93c379-d5af-422f-b3b9-8e8a7d637651 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.0611703 Nov 11 17:14:57.422053 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 56842) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:57.427430 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-d6a6eb21-ed60-48f4-87c3-568dd32a3bba tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Request body: {'floatingip': {'port_id': '5de5065e-0ad8-4180-bd18-4e9927716a88'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:57.461934 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-fd6b1de2-799f-4d8f-ac0c-721deae8698b admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1936590723-network', 'tenant_id': '62e88ea9868543be9ea642bd11db4961'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:57.500955 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d6a6eb21-ed60-48f4-87c3-568dd32a3bba tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for floatingip, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:57.726273 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7318368c-1e18-4007-83aa-b10e7cb3b847 req-f87a2c07-989a-41e6-8b7a-62b6a8475971 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:57.726273 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7318368c-1e18-4007-83aa-b10e7cb3b847 req-f87a2c07-989a-41e6-8b7a-62b6a8475971 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0495026 Nov 11 17:14:57.777528 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7318368c-1e18-4007-83aa-b10e7cb3b847 req-f4b7b7ae-19f2-46ec-8871-48e2ef57b86f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530262 Nov 11 17:14:57.777528 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd6b1de2-799f-4d8f-ac0c-721deae8698b admin admin] Made reservation on behalf of 62e88ea9868543be9ea642bd11db4961 for: {'network': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:14:57.777528 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fd6b1de2-799f-4d8f-ac0c-721deae8698b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:57.789148 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fd6b1de2-799f-4d8f-ac0c-721deae8698b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:57.905347 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fd6b1de2-799f-4d8f-ac0c-721deae8698b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:58.001779 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fd6b1de2-799f-4d8f-ac0c-721deae8698b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:58.013780 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fd6b1de2-799f-4d8f-ac0c-721deae8698b admin admin] vlan segment allocate from pool success with {'vlan_id': 548, 'physical_network': 'physnet1'} {{(pid=102324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:14:58.034045 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fd6b1de2-799f-4d8f-ac0c-721deae8698b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:58.034384 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.segments_db [None req-fd6b1de2-799f-4d8f-ac0c-721deae8698b admin admin] Added segment f4b7462a-aeae-466c-b287-1d035a39e842 of type vlan for network 6def8382-3fac-4ffe-a290-cdf6af09b51a Nov 11 17:14:58.070054 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd6b1de2-799f-4d8f-ac0c-721deae8698b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c21fb1c4-038e-468a-8603-a115acf47197,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:58.085593 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fd6b1de2-799f-4d8f-ac0c-721deae8698b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:58.218665 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fd6b1de2-799f-4d8f-ac0c-721deae8698b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:58.219609 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd6b1de2-799f-4d8f-ac0c-721deae8698b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:58.220322 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fd6b1de2-799f-4d8f-ac0c-721deae8698b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:58.311692 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd6b1de2-799f-4d8f-ac0c-721deae8698b admin admin] Pushing event updated for resources: {'Network': ['ID=6def8382-3fac-4ffe-a290-cdf6af09b51a,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:58.321315 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network 6def8382-3fac-4ffe-a290-cdf6af09b51a details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:14:58.367669 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d6a6eb21-ed60-48f4-87c3-568dd32a3bba tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:58.426848 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-fd6b1de2-799f-4d8f-ac0c-721deae8698b admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.1218977 Nov 11 17:14:58.429989 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56872) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:58.439034 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-c76b7aab-25bb-43f7-b0c8-7594fdf77230 admin admin] Request body: {'subnet': {'network_id': '6def8382-3fac-4ffe-a290-cdf6af09b51a', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1936590723-subnet', 'tenant_id': '62e88ea9868543be9ea642bd11db4961', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:14:58.520761 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d6a6eb21-ed60-48f4-87c3-568dd32a3bba tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:58.601548 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c76b7aab-25bb-43f7-b0c8-7594fdf77230 admin admin] Made reservation on behalf of 62e88ea9868543be9ea642bd11db4961 for: {'subnet': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:14:58.604799 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c76b7aab-25bb-43f7-b0c8-7594fdf77230 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5275488'] for subnet, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:58.614618 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.l3_db [None req-d6a6eb21-ed60-48f4-87c3-568dd32a3bba tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Floating IP 1ca39191-b1b7-4ab8-b6d1-609e6da1fb0f associated. External IP: 172.27.1.197, port: 5de5065e-0ad8-4180-bd18-4e9927716a88. Nov 11 17:14:58.829090 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d6a6eb21-ed60-48f4-87c3-568dd32a3bba tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Router 1a70d97d-215a-45d3-ba2b-b538e79a3278 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:14:58.835784 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c76b7aab-25bb-43f7-b0c8-7594fdf77230 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5436401', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5275470'] for subnet, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:58.895474 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c76b7aab-25bb-43f7-b0c8-7594fdf77230 admin admin] Pushing event updated for resources: {'Subnet': ['ID=316bc385-cbc0-473d-9c75-638fd92e1189,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:14:58.904911 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c76b7aab-25bb-43f7-b0c8-7594fdf77230 admin admin] Checking segment: {'id': 'f4b7462a-aeae-466c-b287-1d035a39e842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 548, 'network_id': '6def8382-3fac-4ffe-a290-cdf6af09b51a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:14:58.905270 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c76b7aab-25bb-43f7-b0c8-7594fdf77230 admin admin] Network hostable DHCP agents. Network: 6def8382-3fac-4ffe-a290-cdf6af09b51a, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:14:58.935327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0517a5f-df34-41dd-9007-d2e31084988d req-77061a91-da5b-48e2-a7ca-fc8b993b6b8b tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:58.936924 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e0517a5f-df34-41dd-9007-d2e31084988d req-77061a91-da5b-48e2-a7ca-fc8b993b6b8b tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.1014571 Nov 11 17:14:58.978830 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c76b7aab-25bb-43f7-b0c8-7594fdf77230 admin admin] Network 6def8382-3fac-4ffe-a290-cdf6af09b51a is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:14:59.017769 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d6a6eb21-ed60-48f4-87c3-568dd32a3bba tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:14:59.022495 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d6a6eb21-ed60-48f4-87c3-568dd32a3bba tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:59.029684 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e0517a5f-df34-41dd-9007-d2e31084988d req-63e79acf-7b57-4c13-bbc6-19660717f7de tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0642948 Nov 11 17:14:59.033943 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5680e9a-f24d-44fd-bebf-47204142975d None None] Sync routers for ids ['1a70d97d-215a-45d3-ba2b-b538e79a3278'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:14:59.045427 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5680e9a-f24d-44fd-bebf-47204142975d None None] Routers {'1a70d97d-215a-45d3-ba2b-b538e79a3278'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:14:59.046147 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-d5680e9a-f24d-44fd-bebf-47204142975d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:14:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1a70d97d-215a-45d3-ba2b-b538e79a3278'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:59.063587 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-d6a6eb21-ed60-48f4-87c3-568dd32a3bba tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "PUT /v2.0/floatingips/1ca39191-b1b7-4ab8-b6d1-609e6da1fb0f HTTP/1.1" status: 200 len: 992 time: 1.6401265 Nov 11 17:14:59.064483 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '51c0e58c-1427-425f-ba26-73999c61ac11', 'tag': '5de5065e-0ad8-4180-bd18-4e9927716a88'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:14:59.067308 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-276a3298-b055-4b6b-8974-89bb1ec60bf6" -d '{"events": [{"name": "network-changed", "server_uuid": "51c0e58c-1427-425f-ba26-73999c61ac11", "tag": "5de5065e-0ad8-4180-bd18-4e9927716a88"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:14:59.076617 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-c76b7aab-25bb-43f7-b0c8-7594fdf77230 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, 6def8382-3fac-4ffe-a290-cdf6af09b51a) {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:14:59.086626 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b29d2d8-c4ce-4208-bc83-2225378effe0 None None] Network 6def8382-3fac-4ffe-a290-cdf6af09b51a requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:14:59.089515 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c76b7aab-25bb-43f7-b0c8-7594fdf77230 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:59.090157 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c76b7aab-25bb-43f7-b0c8-7594fdf77230 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:59.186362 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-d5680e9a-f24d-44fd-bebf-47204142975d None None] Set router 1a70d97d-215a-45d3-ba2b-b538e79a3278 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:14:59.216682 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-c76b7aab-25bb-43f7-b0c8-7594fdf77230 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.7854977 Nov 11 17:14:59.325856 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d8ffaf7-5391-40bf-bb97-e54447e2daeb None None] Network 6def8382-3fac-4ffe-a290-cdf6af09b51a requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:14:59.561757 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-d5680e9a-f24d-44fd-bebf-47204142975d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '1ca39191-b1b7-4ab8-b6d1-609e6da1fb0f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'floating_ip_address': '172.27.1.197', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'port_id': '5de5065e-0ad8-4180-bd18-4e9927716a88', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 120, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'mac_address': 'fa:16:3e:0f:ef:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c0e58c-1427-425f-ba26-73999c61ac11', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:14:28Z', 'updated_at': '2021-11-11T17:14:58Z', 'revision_number': 1, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aa2fc75b-4ee8-4417-b781-eb1c551f1c43', 'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'mac_address': 'fa:16:3e:61:80:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:15Z', 'updated_at': '2021-11-11T17:14:22Z', 'revision_number': 5, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'subnets': [{'id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:59.591687 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5680e9a-f24d-44fd-bebf-47204142975d None None] Checking router: 1a70d97d-215a-45d3-ba2b-b538e79a3278 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:14:59.600489 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5680e9a-f24d-44fd-bebf-47204142975d None None] Routers {'1a70d97d-215a-45d3-ba2b-b538e79a3278'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:14:59.601090 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-d5680e9a-f24d-44fd-bebf-47204142975d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:14:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1a70d97d-215a-45d3-ba2b-b538e79a3278'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:14:59.666207 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:14:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-24d5fc9e-a595-426b-b543-f54f609e72e0 x-openstack-request-id: req-24d5fc9e-a595-426b-b543-f54f609e72e0 {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:14:59.666207 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "51c0e58c-1427-425f-ba26-73999c61ac11", "tag": "5de5065e-0ad8-4180-bd18-4e9927716a88", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:14:59.666207 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-24d5fc9e-a595-426b-b543-f54f609e72e0 {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:14:59.666207 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '51c0e58c-1427-425f-ba26-73999c61ac11', 'tag': '5de5065e-0ad8-4180-bd18-4e9927716a88', 'status': 'completed', 'code': 200} Nov 11 17:14:59.670673 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56916) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:14:59.771888 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89e2ad8c-9a66-402f-9462-547773ae0ff2 req-d43e3e75-2ad0-40c3-86c5-d6db387a24cb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:14:59.773518 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-89e2ad8c-9a66-402f-9462-547773ae0ff2 req-d43e3e75-2ad0-40c3-86c5-d6db387a24cb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0593927 Nov 11 17:14:59.803730 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9b60aea7-78c0-4ec8-909f-59919fd34260 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:14:59.818358 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-d5680e9a-f24d-44fd-bebf-47204142975d None None] Set router 1a70d97d-215a-45d3-ba2b-b538e79a3278 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:14:59.859760 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-89e2ad8c-9a66-402f-9462-547773ae0ff2 req-cfe3fda2-0173-4840-90e1-330e1bee3d38 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698640 Nov 11 17:14:59.922773 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9b60aea7-78c0-4ec8-909f-59919fd34260 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:00.018659 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9b60aea7-78c0-4ec8-909f-59919fd34260 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:00.055691 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b60aea7-78c0-4ec8-909f-59919fd34260 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=89064511-afd0-4824-a0b6-96538f1e1edb,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:00.061543 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-9b60aea7-78c0-4ec8-909f-59919fd34260 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=93c65dab3af24997b6ad6ca5f3a4e04c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3896370 Nov 11 17:15:00.064405 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56926) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:00.076166 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-d5680e9a-f24d-44fd-bebf-47204142975d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '1ca39191-b1b7-4ab8-b6d1-609e6da1fb0f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'floating_ip_address': '172.27.1.197', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'port_id': '5de5065e-0ad8-4180-bd18-4e9927716a88', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 120, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'mac_address': 'fa:16:3e:0f:ef:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c0e58c-1427-425f-ba26-73999c61ac11', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:14:28Z', 'updated_at': '2021-11-11T17:14:58Z', 'revision_number': 1, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aa2fc75b-4ee8-4417-b781-eb1c551f1c43', 'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'mac_address': 'fa:16:3e:61:80:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:15Z', 'updated_at': '2021-11-11T17:14:22Z', 'revision_number': 5, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'subnets': [{'id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:15:00.105914 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5680e9a-f24d-44fd-bebf-47204142975d None None] The sync data for ids ['1a70d97d-215a-45d3-ba2b-b538e79a3278'] in dv-cinder-694140-2-iscsi is: [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '1ca39191-b1b7-4ab8-b6d1-609e6da1fb0f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'floating_ip_address': '172.27.1.197', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'port_id': '5de5065e-0ad8-4180-bd18-4e9927716a88', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 120, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'mac_address': 'fa:16:3e:0f:ef:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c0e58c-1427-425f-ba26-73999c61ac11', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:14:28Z', 'updated_at': '2021-11-11T17:14:58Z', 'revision_number': 1, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aa2fc75b-4ee8-4417-b781-eb1c551f1c43', 'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'mac_address': 'fa:16:3e:61:80:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:15Z', 'updated_at': '2021-11-11T17:14:22Z', 'revision_number': 5, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'subnets': [{'id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:15:00.121579 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-de011388-b49a-41aa-a98c-ebfa80d9fac3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:00.145808 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-de011388-b49a-41aa-a98c-ebfa80d9fac3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:00.220555 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56930) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:00.225338 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-999da5ac-3bb3-4681-ac44-6f89cc5bcb53 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-25350376-network', 'tenant_id': 'e76706615e434c6083c33022dc1a2a93'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:15:00.281532 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-de011388-b49a-41aa-a98c-ebfa80d9fac3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:00.284212 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-de011388-b49a-41aa-a98c-ebfa80d9fac3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:00.287157 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-de011388-b49a-41aa-a98c-ebfa80d9fac3 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/89064511-afd0-4824-a0b6-96538f1e1edb HTTP/1.1" status: 204 len: 168 time: 0.2200174 Nov 11 17:15:00.294356 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de011388-b49a-41aa-a98c-ebfa80d9fac3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=89064511-afd0-4824-a0b6-96538f1e1edb,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:00.335207 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-978811ef-5100-4f2f-b975-1614ee2ec95a None None] New status for floating IP 1ca39191-b1b7-4ab8-b6d1-609e6da1fb0f: ACTIVE {{(pid=102325) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:15:00.344606 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-999da5ac-3bb3-4681-ac44-6f89cc5bcb53 admin admin] Made reservation on behalf of e76706615e434c6083c33022dc1a2a93 for: {'network': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:15:00.350482 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-999da5ac-3bb3-4681-ac44-6f89cc5bcb53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:00.377961 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-999da5ac-3bb3-4681-ac44-6f89cc5bcb53 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:00.462912 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-999da5ac-3bb3-4681-ac44-6f89cc5bcb53 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:00.578485 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-999da5ac-3bb3-4681-ac44-6f89cc5bcb53 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:00.607340 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-999da5ac-3bb3-4681-ac44-6f89cc5bcb53 admin admin] vlan segment allocate from pool success with {'vlan_id': 508, 'physical_network': 'physnet1'} {{(pid=102324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:15:00.613451 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-999da5ac-3bb3-4681-ac44-6f89cc5bcb53 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a92c4537-58d9-4e02-aee7-5206c9ba7dd6,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:00.619660 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-999da5ac-3bb3-4681-ac44-6f89cc5bcb53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:00.619958 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.segments_db [None req-999da5ac-3bb3-4681-ac44-6f89cc5bcb53 admin admin] Added segment 0b5f6b16-509e-4202-9747-664f53d0183d of type vlan for network 29f820c4-01b9-4916-8606-a6708295ba3a Nov 11 17:15:00.658974 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-999da5ac-3bb3-4681-ac44-6f89cc5bcb53 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:00.767351 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-999da5ac-3bb3-4681-ac44-6f89cc5bcb53 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:00.768329 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-999da5ac-3bb3-4681-ac44-6f89cc5bcb53 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:00.768941 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-999da5ac-3bb3-4681-ac44-6f89cc5bcb53 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:00.832213 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-999da5ac-3bb3-4681-ac44-6f89cc5bcb53 admin admin] Pushing event updated for resources: {'Network': ['ID=29f820c4-01b9-4916-8606-a6708295ba3a,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:00.841984 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network 29f820c4-01b9-4916-8606-a6708295ba3a details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:15:00.861844 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-999da5ac-3bb3-4681-ac44-6f89cc5bcb53 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 880 time: 0.6394668 Nov 11 17:15:00.863898 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56944) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:00.869103 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-e501ed44-3edf-4106-a9b9-e4e1e689421e admin admin] Request body: {'subnet': {'network_id': '29f820c4-01b9-4916-8606-a6708295ba3a', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-25350376-subnet', 'tenant_id': 'e76706615e434c6083c33022dc1a2a93', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:15:00.979025 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ba94f1-dfae-4795-8ce5-4dd4a28ab5e9 req-8f6ceace-eb18-4437-a5cf-b9776114d43d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:00.980750 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-89ba94f1-dfae-4795-8ce5-4dd4a28ab5e9 req-8f6ceace-eb18-4437-a5cf-b9776114d43d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0475643 Nov 11 17:15:00.981765 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e501ed44-3edf-4106-a9b9-e4e1e689421e admin admin] Made reservation on behalf of e76706615e434c6083c33022dc1a2a93 for: {'subnet': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:15:00.984007 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e501ed44-3edf-4106-a9b9-e4e1e689421e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5275488'] for subnet, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:01.001450 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-aeb6002a-ce59-4d93-9b5f-ec0d8ae4b7bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:01.088966 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-89ba94f1-dfae-4795-8ce5-4dd4a28ab5e9 req-fda8a53a-5b9f-4616-8ba8-7e8edf51bcfb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1020322 Nov 11 17:15:01.139787 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 56948) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:01.172600 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c61ac920-913a-4815-a0d6-4e796bbaa7fb admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:01.262413 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c61ac920-913a-4815-a0d6-4e796bbaa7fb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:01.281436 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e501ed44-3edf-4106-a9b9-e4e1e689421e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5436401', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5275470'] for subnet, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:01.339968 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e501ed44-3edf-4106-a9b9-e4e1e689421e admin admin] Pushing event updated for resources: {'Subnet': ['ID=44381945-e316-4a03-9daa-6b6430f32c25,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:01.344982 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e501ed44-3edf-4106-a9b9-e4e1e689421e admin admin] Checking segment: {'id': '0b5f6b16-509e-4202-9747-664f53d0183d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': '29f820c4-01b9-4916-8606-a6708295ba3a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:15:01.345379 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e501ed44-3edf-4106-a9b9-e4e1e689421e admin admin] Network hostable DHCP agents. Network: 29f820c4-01b9-4916-8606-a6708295ba3a, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:15:01.367280 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c61ac920-913a-4815-a0d6-4e796bbaa7fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:01.414707 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c61ac920-913a-4815-a0d6-4e796bbaa7fb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f187528-7739-44ea-8a6c-d8ac49b84efa,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:01.419419 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-c61ac920-913a-4815-a0d6-4e796bbaa7fb admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=8536159851614a99a94063b59f578b45&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2786582 Nov 11 17:15:01.422122 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 56952) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:01.455391 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-276a3298-b055-4b6b-8974-89bb1ec60bf6 req-bf44a08e-23e4-44ee-a607-2d021b31d099 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:01.456461 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-276a3298-b055-4b6b-8974-89bb1ec60bf6 req-bf44a08e-23e4-44ee-a607-2d021b31d099 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=3a6e5bdc578b460ab28a883efa598f95&device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 1099 time: 0.0583167 Nov 11 17:15:01.463978 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e501ed44-3edf-4106-a9b9-e4e1e689421e admin admin] Network 29f820c4-01b9-4916-8606-a6708295ba3a is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:15:01.478525 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f8b45b90-7d9a-446b-98a7-87f74c5fcca1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:01.503294 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f8b45b90-7d9a-446b-98a7-87f74c5fcca1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:01.570921 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-276a3298-b055-4b6b-8974-89bb1ec60bf6 req-814c5c47-4702-4ed5-8eef-b5564dcbf4d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:01.572925 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-276a3298-b055-4b6b-8974-89bb1ec60bf6 req-814c5c47-4702-4ed5-8eef-b5564dcbf4d8 service neutron] 10.222.0.10 "GET /v2.0/networks?id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f HTTP/1.1" status: 200 len: 917 time: 0.0996537 Nov 11 17:15:01.573946 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-e501ed44-3edf-4106-a9b9-e4e1e689421e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, 29f820c4-01b9-4916-8606-a6708295ba3a) {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:15:01.578670 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e501ed44-3edf-4106-a9b9-e4e1e689421e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:01.579577 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e501ed44-3edf-4106-a9b9-e4e1e689421e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:01.583238 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e347bbd-29bc-4302-a39c-4cd1fcae6ac1 None None] Network 29f820c4-01b9-4916-8606-a6708295ba3a requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:15:01.590432 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7456d4a6-e6c5-4351-b15f-a0cd6069d61e req-e4e0504f-c4ad-4812-9699-795fc1e7f5a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:01.591875 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7456d4a6-e6c5-4351-b15f-a0cd6069d61e req-e4e0504f-c4ad-4812-9699-795fc1e7f5a3 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ed26d137d98846b9b45708f7e581e9b0&device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 1098 time: 0.0571988 Nov 11 17:15:01.668655 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f8b45b90-7d9a-446b-98a7-87f74c5fcca1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:01.671895 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f8b45b90-7d9a-446b-98a7-87f74c5fcca1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:01.677493 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-f8b45b90-7d9a-446b-98a7-87f74c5fcca1 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/3f187528-7739-44ea-8a6c-d8ac49b84efa HTTP/1.1" status: 204 len: 168 time: 0.2495868 Nov 11 17:15:01.704894 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8b45b90-7d9a-446b-98a7-87f74c5fcca1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f187528-7739-44ea-8a6c-d8ac49b84efa,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:01.725339 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7456d4a6-e6c5-4351-b15f-a0cd6069d61e req-eed39be1-bf73-4b93-b077-4b433f002603 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:01.727439 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7456d4a6-e6c5-4351-b15f-a0cd6069d61e req-eed39be1-bf73-4b93-b077-4b433f002603 service neutron] 10.222.0.10 "GET /v2.0/networks?id=983bda4c-112d-442d-b37a-387818bb1d45 HTTP/1.1" status: 200 len: 919 time: 0.1255670 Nov 11 17:15:01.775779 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-421e4387-041b-4272-88f1-093f6426f3e2 None None] Network 29f820c4-01b9-4916-8606-a6708295ba3a requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:15:01.792538 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7456d4a6-e6c5-4351-b15f-a0cd6069d61e req-6ac77c9c-f0a3-48a7-85e6-7dac89776619 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=56aa9732-ebeb-41d7-ae07-03020a710285 HTTP/1.1" status: 200 len: 217 time: 0.0456409 Nov 11 17:15:01.854685 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7456d4a6-e6c5-4351-b15f-a0cd6069d61e req-36bc5e2a-25e3-4442-81d4-d94721a22d0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:01.856473 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7456d4a6-e6c5-4351-b15f-a0cd6069d61e req-36bc5e2a-25e3-4442-81d4-d94721a22d0b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4 HTTP/1.1" status: 200 len: 858 time: 0.0565703 Nov 11 17:15:01.893622 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7456d4a6-e6c5-4351-b15f-a0cd6069d61e req-1576f64d-aca1-4f9d-8332-2a014d6e0b64 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=983bda4c-112d-442d-b37a-387818bb1d45&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0251601 Nov 11 17:15:01.910828 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-e501ed44-3edf-4106-a9b9-e4e1e689421e admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 1.0381997 Nov 11 17:15:01.913627 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-276a3298-b055-4b6b-8974-89bb1ec60bf6 req-0417ffeb-e9aa-4db2-bd14-f4efc44e90ee service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5de5065e-0ad8-4180-bd18-4e9927716a88 HTTP/1.1" status: 200 len: 1002 time: 0.3181758 Nov 11 17:15:01.993018 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-276a3298-b055-4b6b-8974-89bb1ec60bf6 req-db2e8889-0ae8-40c2-8a08-e97492aeb59c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:01.995652 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-276a3298-b055-4b6b-8974-89bb1ec60bf6 req-db2e8889-0ae8-40c2-8a08-e97492aeb59c service neutron] 10.222.0.10 "GET /v2.0/subnets?id=1a4b11d7-2160-49c3-be78-265f0700c580 HTTP/1.1" status: 200 len: 855 time: 0.0642815 Nov 11 17:15:02.004174 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7456d4a6-e6c5-4351-b15f-a0cd6069d61e req-a4b9f473-8a25-41c9-8078-0e763d7bfdc0 service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1022515 Nov 11 17:15:02.065668 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-276a3298-b055-4b6b-8974-89bb1ec60bf6 req-4b51cdfc-3323-488c-979f-af79b8c867f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:02.067396 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-276a3298-b055-4b6b-8974-89bb1ec60bf6 req-4b51cdfc-3323-488c-979f-af79b8c867f0 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0627332 Nov 11 17:15:02.207542 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-276a3298-b055-4b6b-8974-89bb1ec60bf6 req-5a0ef80a-c572-41b4-80ea-2789d94181b1 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1180496 Nov 11 17:15:02.329596 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc569adf-b443-4102-aa44-b731995fbdc8 req-c72470b5-627c-43aa-af94-48c36cc002b3 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:02.335144 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7456d4a6-e6c5-4351-b15f-a0cd6069d61e req-f18a9279-dc5a-421a-9ab3-b383d783dcea service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3219526 Nov 11 17:15:02.337632 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dc569adf-b443-4102-aa44-b731995fbdc8 req-c72470b5-627c-43aa-af94-48c36cc002b3 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.1335301 Nov 11 17:15:02.413588 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-276a3298-b055-4b6b-8974-89bb1ec60bf6 req-82e5e663-b70f-4ae8-9c3b-4f885e4d16d7 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1901104 Nov 11 17:15:02.435276 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dc569adf-b443-4102-aa44-b731995fbdc8 req-659d18f5-c808-4617-b16d-0047f0c71a1b tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0911973 Nov 11 17:15:03.555327 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5dfa650-8f88-48a1-88a9-3026749c70cf req-04f9a084-6103-4dae-aba7-8780bdd4ffe1 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:03.557492 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e5dfa650-8f88-48a1-88a9-3026749c70cf req-04f9a084-6103-4dae-aba7-8780bdd4ffe1 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0647244 Nov 11 17:15:03.609059 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e5dfa650-8f88-48a1-88a9-3026749c70cf req-42517e07-356c-4d22-b151-1996b0e54e8b tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436337 Nov 11 17:15:03.675508 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fbae6a9b-646a-4bae-9a5e-65b14fde3533 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:04.569226 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:04.755276 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c2ffa6-c1b3-4b6f-af0d-a0a3bef777cc req-8de4954a-3958-4ed4-a15c-000f2462ea4a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:04.756821 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c4c2ffa6-c1b3-4b6f-af0d-a0a3bef777cc req-8de4954a-3958-4ed4-a15c-000f2462ea4a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0758834 Nov 11 17:15:04.830590 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c4c2ffa6-c1b3-4b6f-af0d-a0a3bef777cc req-a4e251cc-2a91-465e-b5e9-5aa66e2d08c7 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631521 Nov 11 17:15:04.871410 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57082) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:05.023002 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d051d69e-9813-491b-accb-986a7867e28a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:05.096593 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d051d69e-9813-491b-accb-986a7867e28a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:05.162198 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d051d69e-9813-491b-accb-986a7867e28a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:05.195553 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-d051d69e-9813-491b-accb-986a7867e28a admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=aa3cf3fdd8cc4c4681e569ad7521a2fe&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3230281 Nov 11 17:15:05.200434 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57096) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:05.246601 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d051d69e-9813-491b-accb-986a7867e28a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=613a0129-b4b2-4ca5-9347-6120159c54f3,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:05.281927 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bc991766-f16a-4cb9-a480-0291ba202075 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:05.303717 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bc991766-f16a-4cb9-a480-0291ba202075 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:05.407569 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 57102) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:05.444749 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffebfaca-b5db-48af-82d9-0c541263f92f req-61d46ed7-84ac-4002-8b45-967e7b6551d8 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:05.446666 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ffebfaca-b5db-48af-82d9-0c541263f92f req-61d46ed7-84ac-4002-8b45-967e7b6551d8 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 945 time: 0.0552213 Nov 11 17:15:05.476684 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bc991766-f16a-4cb9-a480-0291ba202075 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:05.480735 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bc991766-f16a-4cb9-a480-0291ba202075 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:05.481899 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-bc991766-f16a-4cb9-a480-0291ba202075 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/613a0129-b4b2-4ca5-9347-6120159c54f3 HTTP/1.1" status: 204 len: 168 time: 0.2801626 Nov 11 17:15:05.500527 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc991766-f16a-4cb9-a480-0291ba202075 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=613a0129-b4b2-4ca5-9347-6120159c54f3,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:05.516814 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ffebfaca-b5db-48af-82d9-0c541263f92f req-ff047adf-c204-4968-a7a0-c35de60b8178 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621653 Nov 11 17:15:05.572877 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4d2d834f-c155-4938-a691-eded71535914 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:05.646675 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4d2d834f-c155-4938-a691-eded71535914 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:05.824448 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4d2d834f-c155-4938-a691-eded71535914 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:05.869708 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-4d2d834f-c155-4938-a691-eded71535914 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=f1b538b628ba44919570f912fc220e51&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4609470 Nov 11 17:15:05.870869 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d2d834f-c155-4938-a691-eded71535914 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=432cae4d-cf96-443a-a7ca-3c395ed95b9c,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:05.872411 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57112) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:05.951138 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d3186d30-aaaf-4825-9143-873ea2719415 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:05.962977 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7989c52b-3756-4970-8ea2-a80ba45277be req-43f6c980-01d8-4167-b322-18c434493748 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:05.964510 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7989c52b-3756-4970-8ea2-a80ba45277be req-43f6c980-01d8-4167-b322-18c434493748 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0735843 Nov 11 17:15:06.003013 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d3186d30-aaaf-4825-9143-873ea2719415 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:06.052881 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7989c52b-3756-4970-8ea2-a80ba45277be req-ae3b99ba-5d97-495e-a8cf-20286cfa3928 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0797548 Nov 11 17:15:06.214319 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d3186d30-aaaf-4825-9143-873ea2719415 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:06.217487 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d3186d30-aaaf-4825-9143-873ea2719415 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:06.220789 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-d3186d30-aaaf-4825-9143-873ea2719415 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/432cae4d-cf96-443a-a7ca-3c395ed95b9c HTTP/1.1" status: 204 len: 168 time: 0.3447437 Nov 11 17:15:06.227705 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3186d30-aaaf-4825-9143-873ea2719415 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=432cae4d-cf96-443a-a7ca-3c395ed95b9c,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:06.315416 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:06.477088 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57126) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:06.495010 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e3caa997-4d1c-4bcb-b228-713071538972 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:06.569950 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e3caa997-4d1c-4bcb-b228-713071538972 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:06.661253 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92f1fcdb-c367-42df-91df-e88081095c90 req-fbd4cc26-d5ce-476a-a14e-641ffd39186a tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:06.665122 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-92f1fcdb-c367-42df-91df-e88081095c90 req-fbd4cc26-d5ce-476a-a14e-641ffd39186a tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 945 time: 0.0521863 Nov 11 17:15:06.665122 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e3caa997-4d1c-4bcb-b228-713071538972 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:06.720829 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-e3caa997-4d1c-4bcb-b228-713071538972 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=f4d6d06bb99843b9abbd68f3d2730c48&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2425528 Nov 11 17:15:06.723461 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 57132) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:06.724320 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3caa997-4d1c-4bcb-b228-713071538972 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=710f833e-ba8c-4d9c-9bab-7e89ebcc3cad,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:06.752433 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-92f1fcdb-c367-42df-91df-e88081095c90 req-d84ae3aa-1440-48f8-a609-11607229538b tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0790579 Nov 11 17:15:06.782125 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c66b8d5b-9655-45ae-8723-495b79d104a8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:06.803006 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c66b8d5b-9655-45ae-8723-495b79d104a8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:06.944034 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c66b8d5b-9655-45ae-8723-495b79d104a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:06.946744 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c66b8d5b-9655-45ae-8723-495b79d104a8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:06.949666 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-c66b8d5b-9655-45ae-8723-495b79d104a8 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/710f833e-ba8c-4d9c-9bab-7e89ebcc3cad HTTP/1.1" status: 204 len: 168 time: 0.2234523 Nov 11 17:15:06.955920 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c66b8d5b-9655-45ae-8723-495b79d104a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=710f833e-ba8c-4d9c-9bab-7e89ebcc3cad,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:07.017007 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 57138) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:07.030355 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-21eff446-a324-42e2-9a34-d28bc1c340cd admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:07.058373 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:07.119021 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-21eff446-a324-42e2-9a34-d28bc1c340cd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:07.183169 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b323fd55-88b6-460d-b2fb-bbc565280eb5 req-4c4fa36f-7c9e-4928-9005-a2c77b9be97d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:07.184673 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b323fd55-88b6-460d-b2fb-bbc565280eb5 req-4c4fa36f-7c9e-4928-9005-a2c77b9be97d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0506017 Nov 11 17:15:07.201253 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-21eff446-a324-42e2-9a34-d28bc1c340cd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:07.232148 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b323fd55-88b6-460d-b2fb-bbc565280eb5 req-5744d5c1-2b1f-4dcd-8e18-4a6c794bdd6e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414131 Nov 11 17:15:07.241110 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-21eff446-a324-42e2-9a34-d28bc1c340cd admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=bcf3824c7bcd4e2fb0a5e44e478e8034&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2230053 Nov 11 17:15:07.241987 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21eff446-a324-42e2-9a34-d28bc1c340cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f7cdc5a-bd09-4b3a-9f6b-8c5f85d64c23,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:07.244129 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57146) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:07.308694 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5697b5d3-675a-4cb6-aaff-0fefdd58879a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:07.332667 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5697b5d3-675a-4cb6-aaff-0fefdd58879a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:07.544132 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5697b5d3-675a-4cb6-aaff-0fefdd58879a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:07.546819 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5697b5d3-675a-4cb6-aaff-0fefdd58879a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:07.548004 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-5697b5d3-675a-4cb6-aaff-0fefdd58879a admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/1f7cdc5a-bd09-4b3a-9f6b-8c5f85d64c23 HTTP/1.1" status: 204 len: 168 time: 0.3004382 Nov 11 17:15:07.559107 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5697b5d3-675a-4cb6-aaff-0fefdd58879a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f7cdc5a-bd09-4b3a-9f6b-8c5f85d64c23,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:07.877155 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03787d40-4146-4896-bdc9-bfe610299d89 req-2a85abdb-e448-407c-b480-b172a2860156 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:07.878891 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-03787d40-4146-4896-bdc9-bfe610299d89 req-2a85abdb-e448-407c-b480-b172a2860156 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 945 time: 0.0533085 Nov 11 17:15:07.930198 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-03787d40-4146-4896-bdc9-bfe610299d89 req-984a8c24-f2f7-4880-a412-8bd13a0d5388 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452194 Nov 11 17:15:08.236212 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57178) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:08.250020 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:08.379495 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e453af7-a4de-4970-9216-6c41796e7e88 req-8ad90c08-8c1b-473d-b23c-51f780b91e02 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:08.380963 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9e453af7-a4de-4970-9216-6c41796e7e88 req-8ad90c08-8c1b-473d-b23c-51f780b91e02 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0724242 Nov 11 17:15:08.382988 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:08.432990 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9e453af7-a4de-4970-9216-6c41796e7e88 req-47c3a31e-f0fd-456f-bc85-06c971f85011 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443943 Nov 11 17:15:08.527039 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:08.565432 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=200abce4abbe41ad9945f9303cec8910&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3279922 Nov 11 17:15:08.566300 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88320e72-54e0-4a7b-9e25-836ac9d1c689,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:08.568202 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 57188) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:08.574341 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:08.574793 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:08.575145 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:08.575483 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:08.575821 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:08.576192 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:08.576479 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:08.576807 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:08.577136 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:08.577459 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:08.577781 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:08.578102 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-285c3ebe-7192-4d0b-b25c-9626a516a050 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:08.618674 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5dd5e1cb-c097-4fd9-860e-fc718f2f7001 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:08.641289 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5dd5e1cb-c097-4fd9-860e-fc718f2f7001 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:08.749908 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5dd5e1cb-c097-4fd9-860e-fc718f2f7001 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:08.752633 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5dd5e1cb-c097-4fd9-860e-fc718f2f7001 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:08.753841 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-5dd5e1cb-c097-4fd9-860e-fc718f2f7001 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/88320e72-54e0-4a7b-9e25-836ac9d1c689 HTTP/1.1" status: 204 len: 168 time: 0.1845489 Nov 11 17:15:08.762572 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dd5e1cb-c097-4fd9-860e-fc718f2f7001 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88320e72-54e0-4a7b-9e25-836ac9d1c689,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:09.057643 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3749b0d-a0a9-42cd-8d54-3ff5fd9aa088 req-dc77ebe0-341b-49aa-8086-91996d4a6c70 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:09.059210 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a3749b0d-a0a9-42cd-8d54-3ff5fd9aa088 req-dc77ebe0-341b-49aa-8086-91996d4a6c70 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 945 time: 0.0570085 Nov 11 17:15:09.123250 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a3749b0d-a0a9-42cd-8d54-3ff5fd9aa088 req-4cbcf0bd-f991-4c85-8b6c-ce027f1c3fdf tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0572731 Nov 11 17:15:09.554029 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1e984b4-7d53-4a76-85c9-7ebe210f5b2d req-98988983-9298-4ea7-bc2d-7389bbd6228e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:09.556031 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c1e984b4-7d53-4a76-85c9-7ebe210f5b2d req-98988983-9298-4ea7-bc2d-7389bbd6228e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0562518 Nov 11 17:15:09.609978 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c1e984b4-7d53-4a76-85c9-7ebe210f5b2d req-51046a08-bf50-4876-8247-20b763ef308f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473983 Nov 11 17:15:10.279262 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1b14452-bcb8-482c-ade7-fa7e4490478f req-cb36a6fa-1d2f-4e20-b9b5-0fe58da631bc tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:10.280678 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a1b14452-bcb8-482c-ade7-fa7e4490478f req-cb36a6fa-1d2f-4e20-b9b5-0fe58da631bc tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.10 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 945 time: 0.0965581 Nov 11 17:15:10.294993 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a02f3adf-c507-49f7-bd03-88c879e69623 req-0e437ea2-7742-414f-99b9-a0d05055b58e tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:10.298274 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a02f3adf-c507-49f7-bd03-88c879e69623 req-0e437ea2-7742-414f-99b9-a0d05055b58e tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 945 time: 0.0825551 Nov 11 17:15:10.457118 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a02f3adf-c507-49f7-bd03-88c879e69623 req-6e778f51-9c60-4278-bcfc-ed3e33c9b688 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/security-groups?id=90913116-0d08-4375-aa52-9d7cd00f37d2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1477835 Nov 11 17:15:10.562356 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-a1b14452-bcb8-482c-ade7-fa7e4490478f req-ff4ff918-b0c9-4505-a676-595c015f6d58 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Deleting port fd585263-ae7c-46ac-bb91-f0e1daa4026d {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:15:10.563719 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-a1b14452-bcb8-482c-ade7-fa7e4490478f req-ff4ff918-b0c9-4505-a676-595c015f6d58 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:10.671971 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-a1b14452-bcb8-482c-ade7-fa7e4490478f req-ff4ff918-b0c9-4505-a676-595c015f6d58 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] For port fd585263-ae7c-46ac-bb91-f0e1daa4026d, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=fd585263-ae7c-46ac-bb91-f0e1daa4026d,segment=NetworkSegment(0a2ff661-8b92-4963-a90f-415ffdc06b18),segment_id=0a2ff661-8b92-4963-a90f-415ffdc06b18)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:15:10.672331 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-a1b14452-bcb8-482c-ade7-fa7e4490478f req-ff4ff918-b0c9-4505-a676-595c015f6d58 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:10.690236 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-a1b14452-bcb8-482c-ade7-fa7e4490478f req-ff4ff918-b0c9-4505-a676-595c015f6d58 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Calling delete_port for fd585263-ae7c-46ac-bb91-f0e1daa4026d owned by compute:nova {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:15:10.746323 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1111675e-a4c1-4d9f-bcb2-b972a41137da req-5a4282d3-e1e8-4eb4-88f9-ea3ea5200c82 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:10.748195 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1111675e-a4c1-4d9f-bcb2-b972a41137da req-5a4282d3-e1e8-4eb4-88f9-ea3ea5200c82 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0601003 Nov 11 17:15:10.819223 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1111675e-a4c1-4d9f-bcb2-b972a41137da req-69032b72-e65d-40c3-b0f9-1409162897bf tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636947 Nov 11 17:15:10.946953 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-87df6487-f855-413f-8f4b-162762d7f235 req-7973bf72-d913-433c-b282-fd1b6cbf0f71 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0793781 Nov 11 17:15:10.995894 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-a1b14452-bcb8-482c-ade7-fa7e4490478f req-ff4ff918-b0c9-4505-a676-595c015f6d58 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:11.010935 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['fd585263-ae7c-46ac-bb91-f0e1daa4026d'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:15:11.040048 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87df6487-f855-413f-8f4b-162762d7f235 req-77b2e7ac-ea3b-46da-a71c-e85fdf5df477 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:11.044128 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-87df6487-f855-413f-8f4b-162762d7f235 req-77b2e7ac-ea3b-46da-a71c-e85fdf5df477 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ed26d137d98846b9b45708f7e581e9b0&device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 1098 time: 0.0438418 Nov 11 17:15:11.046247 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff4ff918-b0c9-4505-a676-595c015f6d58 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Pushing event deleted for resources: {'Port': ['ID=fd585263-ae7c-46ac-bb91-f0e1daa4026d,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:11.116369 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-a1b14452-bcb8-482c-ade7-fa7e4490478f req-ff4ff918-b0c9-4505-a676-595c015f6d58 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] No DVR routers for this DVR port fd585263-ae7c-46ac-bb91-f0e1daa4026d on host hv-cinder-69414 {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:15:11.120221 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-a1b14452-bcb8-482c-ade7-fa7e4490478f req-ff4ff918-b0c9-4505-a676-595c015f6d58 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:11.123531 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a1b14452-bcb8-482c-ade7-fa7e4490478f req-ff4ff918-b0c9-4505-a676-595c015f6d58 tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.10 "DELETE /v2.0/ports/fd585263-ae7c-46ac-bb91-f0e1daa4026d HTTP/1.1" status: 204 len: 173 time: 0.8243203 Nov 11 17:15:11.123990 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a653c39c-4234-4aa6-bfbb-d867ce904738', 'name': 'network-vif-deleted', 'tag': 'fd585263-ae7c-46ac-bb91-f0e1daa4026d'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:15:11.126332 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fc1801ef-2c90-4062-a70a-c62bfec40109" -d '{"events": [{"server_uuid": "a653c39c-4234-4aa6-bfbb-d867ce904738", "name": "network-vif-deleted", "tag": "fd585263-ae7c-46ac-bb91-f0e1daa4026d"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:15:11.186078 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:15:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e680cf9f-f2c4-45da-99b4-3b2cce8aed82 x-openstack-request-id: req-e680cf9f-f2c4-45da-99b4-3b2cce8aed82 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:15:11.186078 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a653c39c-4234-4aa6-bfbb-d867ce904738", "name": "network-vif-deleted", "tag": "fd585263-ae7c-46ac-bb91-f0e1daa4026d", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:15:11.186078 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-e680cf9f-f2c4-45da-99b4-3b2cce8aed82 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:15:11.186078 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a653c39c-4234-4aa6-bfbb-d867ce904738', 'name': 'network-vif-deleted', 'tag': 'fd585263-ae7c-46ac-bb91-f0e1daa4026d', 'status': 'completed', 'code': 200} Nov 11 17:15:11.186596 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87df6487-f855-413f-8f4b-162762d7f235 req-0c5bfe21-e73d-47f9-ba87-00417fbbe7bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:11.186596 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-87df6487-f855-413f-8f4b-162762d7f235 req-0c5bfe21-e73d-47f9-ba87-00417fbbe7bd service neutron] 10.222.0.10 "GET /v2.0/networks?id=983bda4c-112d-442d-b37a-387818bb1d45 HTTP/1.1" status: 200 len: 919 time: 0.1051514 Nov 11 17:15:11.233499 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-87df6487-f855-413f-8f4b-162762d7f235 req-fd36256b-37a4-42b1-a8db-c5d442ec0f00 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=904b538c-2fcd-42a3-bc02-26c84d4d00cb HTTP/1.1" status: 200 len: 217 time: 0.0393543 Nov 11 17:15:11.287777 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87df6487-f855-413f-8f4b-162762d7f235 req-3ba27a9b-904d-4dc8-bae8-b9cd7400c416 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:11.289246 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-87df6487-f855-413f-8f4b-162762d7f235 req-3ba27a9b-904d-4dc8-bae8-b9cd7400c416 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4 HTTP/1.1" status: 200 len: 858 time: 0.0482912 Nov 11 17:15:11.339614 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-87df6487-f855-413f-8f4b-162762d7f235 req-d77795d8-e939-44aa-a6fb-4fbfd46f4879 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=983bda4c-112d-442d-b37a-387818bb1d45&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0242684 Nov 11 17:15:11.450259 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-87df6487-f855-413f-8f4b-162762d7f235 req-1079415c-4520-4ae5-a4b8-24ce73697130 service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0961130 Nov 11 17:15:11.552398 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-87df6487-f855-413f-8f4b-162762d7f235 req-6a09cc9e-6359-47ff-b002-a308ce3ecbd1 service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0916224 Nov 11 17:15:11.573635 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ba9d178b-3e99-4e75-99ed-74887e750d3f req-d00e05c4-32b7-459f-8578-b751d1f3510d tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 210 time: 0.0262415 Nov 11 17:15:11.941998 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b142f7a-5d88-4879-9778-15a37e4a737e req-e9bc11b6-5340-4677-936a-98641d7276eb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:11.948735 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7b142f7a-5d88-4879-9778-15a37e4a737e req-e9bc11b6-5340-4677-936a-98641d7276eb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0568755 Nov 11 17:15:12.013546 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7b142f7a-5d88-4879-9778-15a37e4a737e req-98a01eae-b0a3-4fd2-bdad-8fd33ddc02a0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618682 Nov 11 17:15:12.682999 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-3a857203-927c-4b6f-a003-a84784262441 req-513081ff-356b-44dc-b025-25fd6fdb5c5a tempest-DeleteServersTestJSON-1230618368 tempest-DeleteServersTestJSON-1230618368-project] 10.222.0.16 "GET /v2.0/ports?device_id=a653c39c-4234-4aa6-bfbb-d867ce904738 HTTP/1.1" status: 200 len: 210 time: 0.0257583 Nov 11 17:15:13.170028 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10d5153c-7f66-4ec6-8d3b-5eff759abbb5 req-e16734a1-cc22-489e-876e-8be521e4348e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:13.179570 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-10d5153c-7f66-4ec6-8d3b-5eff759abbb5 req-e16734a1-cc22-489e-876e-8be521e4348e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0721707 Nov 11 17:15:13.233610 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-10d5153c-7f66-4ec6-8d3b-5eff759abbb5 req-12dafad4-701d-4ea4-b64f-16241f30e656 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0531592 Nov 11 17:15:13.521712 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 57374) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:13.643723 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:13.717908 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:13.864214 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:13.906397 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=a93dc2902b554bf496000dc24ae0d987&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3835661 Nov 11 17:15:13.908430 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=617034d4-de0b-4081-bb4b-e8a35b5d7d98,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:13.917908 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:13.917908 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:13.917908 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:13.917908 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:13.918329 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57402) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:13.924636 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:13.925036 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:13.925385 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:13.925815 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:13.926183 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:13.926607 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:13.926814 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:13.927140 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5d673e-0e3a-453c-ad59-a3be54896a20 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:15:13.983435 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-86218175-1bc4-4e24-b840-b6193fdae063 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:14.004062 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-86218175-1bc4-4e24-b840-b6193fdae063 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:14.155556 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-86218175-1bc4-4e24-b840-b6193fdae063 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:14.159129 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-86218175-1bc4-4e24-b840-b6193fdae063 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:14.160401 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-86218175-1bc4-4e24-b840-b6193fdae063 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/617034d4-de0b-4081-bb4b-e8a35b5d7d98 HTTP/1.1" status: 204 len: 168 time: 0.2413690 Nov 11 17:15:14.169242 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86218175-1bc4-4e24-b840-b6193fdae063 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=617034d4-de0b-4081-bb4b-e8a35b5d7d98,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:14.366361 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68b491c3-000d-4d31-a091-1b777815fc88 req-200cb3b0-6630-4cc2-9b40-43e868266ff0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:14.368293 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-68b491c3-000d-4d31-a091-1b777815fc88 req-200cb3b0-6630-4cc2-9b40-43e868266ff0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0574381 Nov 11 17:15:14.422182 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-68b491c3-000d-4d31-a091-1b777815fc88 req-2ebe9b76-3a78-4cc4-809d-e65f69b991b3 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468943 Nov 11 17:15:14.876402 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device fd585263-ae7c-46ac-bb91-f0e1daa4026d no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:15:14.897397 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: fd585263-ae7c-46ac-bb91-f0e1daa4026d {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:15:14.897397 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device fd585263-ae7c-46ac-bb91-f0e1daa4026d not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:15:14.962407 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57442) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:14.975534 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-55918f79-376b-41dc-9895-937fef4afa19 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.058616 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-55918f79-376b-41dc-9895-937fef4afa19 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.149324 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-55918f79-376b-41dc-9895-937fef4afa19 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.187450 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-55918f79-376b-41dc-9895-937fef4afa19 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=2af6c86fb64d47f386bb55dff766769c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2239137 Nov 11 17:15:15.189440 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55918f79-376b-41dc-9895-937fef4afa19 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5173913b-8bc6-43af-bce1-4e1ea8d045dd,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:15.190136 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 57448) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:15.241980 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5f1cfef2-5a8e-40c1-b2fd-6bde8c5ebf02 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.263843 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5f1cfef2-5a8e-40c1-b2fd-6bde8c5ebf02 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.413870 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5f1cfef2-5a8e-40c1-b2fd-6bde8c5ebf02 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.413870 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5f1cfef2-5a8e-40c1-b2fd-6bde8c5ebf02 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.413870 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-5f1cfef2-5a8e-40c1-b2fd-6bde8c5ebf02 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/5173913b-8bc6-43af-bce1-4e1ea8d045dd HTTP/1.1" status: 204 len: 168 time: 0.2196159 Nov 11 17:15:15.419924 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f1cfef2-5a8e-40c1-b2fd-6bde8c5ebf02 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5173913b-8bc6-43af-bce1-4e1ea8d045dd,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:15.427980 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 57458) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:15.476748 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_v2 [None req-4e80aa50-943e-4c27-9a41-198b32db9bcc admin admin] Deleting subnet e608e66c-e895-4298-9bef-647d1d33f98e {{(pid=102323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:15:15.480771 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4e80aa50-943e-4c27-9a41-198b32db9bcc admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.517522 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4e80aa50-943e-4c27-9a41-198b32db9bcc admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5777079'] for subnet, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.546574 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d822a5ad-939e-4bb0-ad95-befaf58a0dd7 req-10015df9-f67b-48ed-8f79-43f4c229ba8d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:15.548028 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d822a5ad-939e-4bb0-ad95-befaf58a0dd7 req-10015df9-f67b-48ed-8f79-43f4c229ba8d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0510192 Nov 11 17:15:15.565930 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4e80aa50-943e-4c27-9a41-198b32db9bcc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.596958 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d822a5ad-939e-4bb0-ad95-befaf58a0dd7 req-7d7d9bd8-70d7-46ed-848d-0e9922749783 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426838 Nov 11 17:15:15.681754 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4e80aa50-943e-4c27-9a41-198b32db9bcc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5720643', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5388326'] for subnet, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.708659 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e80aa50-943e-4c27-9a41-198b32db9bcc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e608e66c-e895-4298-9bef-647d1d33f98e,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:15.710692 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4e80aa50-943e-4c27-9a41-198b32db9bcc admin admin] Publish callbacks [] for subnet, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.714411 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-4e80aa50-943e-4c27-9a41-198b32db9bcc admin admin] 10.222.0.16 "DELETE /v2.0/subnets/e608e66c-e895-4298-9bef-647d1d33f98e HTTP/1.1" status: 204 len: 168 time: 0.2845972 Nov 11 17:15:15.716981 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 57462) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:15.792067 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a7e08b16-a065-4b2d-ad7a-861a3ecd85cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.878671 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a7e08b16-a065-4b2d-ad7a-861a3ecd85cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.900324 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-a7e08b16-a065-4b2d-ad7a-861a3ecd85cd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dee85f4f-de83-4218-8f3b-9f48a95689a9']}} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:15:15.910665 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-a7e08b16-a065-4b2d-ad7a-861a3ecd85cd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0a2ff661-8b92-4963-a90f-415ffdc06b18') {'for_net_delete': True} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:15:15.918842 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-a7e08b16-a065-4b2d-ad7a-861a3ecd85cd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0a2ff661-8b92-4963-a90f-415ffdc06b18') {} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:15:15.920165 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a7e08b16-a065-4b2d-ad7a-861a3ecd85cd admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5777070'] for segment, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.936863 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a7e08b16-a065-4b2d-ad7a-861a3ecd85cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.952864 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a7e08b16-a065-4b2d-ad7a-861a3ecd85cd admin admin] Releasing vlan 532 on physical network physnet1 to pool {{(pid=102323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:15:15.953273 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a7e08b16-a065-4b2d-ad7a-861a3ecd85cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5720605'] for segment, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: Traceback (most recent call last): Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: timer() Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: cb(*args, **kw) Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: return func(*args, **kwargs) Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: self._notify() Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: self.callback(batched_events) Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: event.method(event) Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: return f(self, *a, **k) Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._get(url).json() Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: return self.request(url, 'GET', **kwargs) Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:15:15.955733 dv-cinder-694140-2-iscsi neutron-server[102323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:15:16.098147 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a7e08b16-a065-4b2d-ad7a-861a3ecd85cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:16.103564 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a7e08b16-a065-4b2d-ad7a-861a3ecd85cd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:16.109164 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-a7e08b16-a065-4b2d-ad7a-861a3ecd85cd admin admin] 10.222.0.16 "DELETE /v2.0/networks/dee85f4f-de83-4218-8f3b-9f48a95689a9 HTTP/1.1" status: 204 len: 168 time: 0.3896306 Nov 11 17:15:16.119253 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7e08b16-a065-4b2d-ad7a-861a3ecd85cd admin admin] Pushing event deleted for resources: {'Network': ['ID=dee85f4f-de83-4218-8f3b-9f48a95689a9,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:16.143638 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:15:16.562843 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 57510) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:16.613625 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-842f5bf1-0f7f-45a5-8611-03af8b0b7827 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=cceb60931e5541518c468df87510c262&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0492873 Nov 11 17:15:16.615595 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57516) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:16.684641 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0d06531d-79e7-4665-aee1-113246a0b483 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:16.725511 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0d06531d-79e7-4665-aee1-113246a0b483 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:16.830161 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8d7137f-bc88-49d7-90a4-b669611bba5b req-5cf252ac-c1a7-4274-8364-a04b78b0737b tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:16.833195 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d8d7137f-bc88-49d7-90a4-b669611bba5b req-5cf252ac-c1a7-4274-8364-a04b78b0737b tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0728989 Nov 11 17:15:16.840086 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:16.898913 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d8d7137f-bc88-49d7-90a4-b669611bba5b req-b7c2a4da-7328-42a6-993c-141d83df0046 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496051 Nov 11 17:15:16.927058 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57536) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:16.977924 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0d06531d-79e7-4665-aee1-113246a0b483 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:16.981918 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0d06531d-79e7-4665-aee1-113246a0b483 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:16.983333 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-0d06531d-79e7-4665-aee1-113246a0b483 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/90913116-0d08-4375-aa52-9d7cd00f37d2 HTTP/1.1" status: 204 len: 168 time: 0.3660841 Nov 11 17:15:16.992551 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d06531d-79e7-4665-aee1-113246a0b483 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=90913116-0d08-4375-aa52-9d7cd00f37d2,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:17.050003 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-59f3ec5f-4173-4a23-b070-c52b64459ae3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:17.133634 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-59f3ec5f-4173-4a23-b070-c52b64459ae3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:17.247170 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-59f3ec5f-4173-4a23-b070-c52b64459ae3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:17.284544 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59f3ec5f-4173-4a23-b070-c52b64459ae3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=01c752fd-32d2-48d5-bf7a-b4fa6ecc7d4e,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:17.297361 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-59f3ec5f-4173-4a23-b070-c52b64459ae3 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=4e0fbb81579b40d792c40826ae506016&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3692167 Nov 11 17:15:17.300636 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 57558) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:17.351672 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5414b9ef-716a-413f-b05a-d35119efe2d7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:17.374870 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5414b9ef-716a-413f-b05a-d35119efe2d7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:17.517387 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5414b9ef-716a-413f-b05a-d35119efe2d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:17.521891 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5414b9ef-716a-413f-b05a-d35119efe2d7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:17.525642 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-5414b9ef-716a-413f-b05a-d35119efe2d7 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/01c752fd-32d2-48d5-bf7a-b4fa6ecc7d4e HTTP/1.1" status: 204 len: 168 time: 0.2216609 Nov 11 17:15:17.532316 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5414b9ef-716a-413f-b05a-d35119efe2d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=01c752fd-32d2-48d5-bf7a-b4fa6ecc7d4e,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:18.026782 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77774fb7-8f37-4e4f-b8da-d1568694d5da req-64e1f8a6-c0ac-41d0-a8e7-5c80a32dfd72 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:18.029106 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-77774fb7-8f37-4e4f-b8da-d1568694d5da req-64e1f8a6-c0ac-41d0-a8e7-5c80a32dfd72 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0619650 Nov 11 17:15:18.088871 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-77774fb7-8f37-4e4f-b8da-d1568694d5da req-62792272-0c96-47b4-91d6-09d2575e4301 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517764 Nov 11 17:15:18.501580 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57626) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:18.515767 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bf9c77e0-bd04-42a1-99da-21b69b8df72d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:18.598396 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bf9c77e0-bd04-42a1-99da-21b69b8df72d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:18.677349 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bf9c77e0-bd04-42a1-99da-21b69b8df72d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:18.730470 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-bf9c77e0-bd04-42a1-99da-21b69b8df72d admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=991ca76b8052453daee096462b253aaa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2284887 Nov 11 17:15:18.731666 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf9c77e0-bd04-42a1-99da-21b69b8df72d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a207cb0d-8ea1-484e-a5bf-8eac3597c432,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:18.733038 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 57632) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:18.786107 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5b39087b-ffe7-4184-92c8-4e95be98c621 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:18.808189 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5b39087b-ffe7-4184-92c8-4e95be98c621 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:18.932724 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5b39087b-ffe7-4184-92c8-4e95be98c621 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:18.935679 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5b39087b-ffe7-4184-92c8-4e95be98c621 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:18.937640 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-5b39087b-ffe7-4184-92c8-4e95be98c621 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/a207cb0d-8ea1-484e-a5bf-8eac3597c432 HTTP/1.1" status: 204 len: 168 time: 0.2027705 Nov 11 17:15:18.945127 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b39087b-ffe7-4184-92c8-4e95be98c621 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a207cb0d-8ea1-484e-a5bf-8eac3597c432,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:19.217330 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9020fbf-f8c8-4ad8-b30c-c17486076547 req-56544012-b6c0-4ac5-b2e3-2744b667171a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:19.219049 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c9020fbf-f8c8-4ad8-b30c-c17486076547 req-56544012-b6c0-4ac5-b2e3-2744b667171a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0544131 Nov 11 17:15:19.295775 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c9020fbf-f8c8-4ad8-b30c-c17486076547 req-60c382b4-310b-4427-92e2-bea8e300838c tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0703304 Nov 11 17:15:20.421692 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04105e61-202c-47fd-a771-4dbeac781a70 req-1caabb23-a302-491e-8274-5cfc93588abb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:20.427121 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-04105e61-202c-47fd-a771-4dbeac781a70 req-1caabb23-a302-491e-8274-5cfc93588abb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0588117 Nov 11 17:15:20.469828 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-04105e61-202c-47fd-a771-4dbeac781a70 req-903d167b-663f-4815-851d-c2b2a2cf7b0d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404739 Nov 11 17:15:21.190990 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57744) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:21.381592 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9c4f2eb7-7f9a-40a8-8404-30fc57d34aa5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:21.461524 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9c4f2eb7-7f9a-40a8-8404-30fc57d34aa5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:21.552678 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9c4f2eb7-7f9a-40a8-8404-30fc57d34aa5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:21.566786 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 57762) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:21.620379 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c4f2eb7-7f9a-40a8-8404-30fc57d34aa5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=78d98d19-121d-4726-8021-605dd061c59a,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:21.633592 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 57766) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:21.641871 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-9c4f2eb7-7f9a-40a8-8404-30fc57d34aa5 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=6212cf4db71a4c42b0e47a46686bf4f7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4495666 Nov 11 17:15:21.669778 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbd4cc1d-637a-452c-8222-8c8a5647e05e req-201ad65e-7f36-48ea-8649-7fc1513880dc tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:21.671372 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bbd4cc1d-637a-452c-8222-8c8a5647e05e req-201ad65e-7f36-48ea-8649-7fc1513880dc tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.1285999 Nov 11 17:15:21.704565 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f487928f-55f3-4fab-a504-79f8def2501f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:21.707367 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-0d16d686-69b9-486e-baef-022c3ca0bdd9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:21.727239 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bbd4cc1d-637a-452c-8222-8c8a5647e05e req-9f96d173-213a-4065-b741-f36b7fe06666 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488682 Nov 11 17:15:21.744314 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-0d16d686-69b9-486e-baef-022c3ca0bdd9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:21.833534 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f487928f-55f3-4fab-a504-79f8def2501f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:21.903821 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-0d16d686-69b9-486e-baef-022c3ca0bdd9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:21.906347 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-0d16d686-69b9-486e-baef-022c3ca0bdd9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:21.907567 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-0d16d686-69b9-486e-baef-022c3ca0bdd9 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/78d98d19-121d-4726-8021-605dd061c59a HTTP/1.1" status: 204 len: 168 time: 0.2730260 Nov 11 17:15:21.915464 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d16d686-69b9-486e-baef-022c3ca0bdd9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=78d98d19-121d-4726-8021-605dd061c59a,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:21.944008 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f487928f-55f3-4fab-a504-79f8def2501f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:21.985612 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-f487928f-55f3-4fab-a504-79f8def2501f admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=b6c7d23a3d54410d9f56b71affe2e038&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4177186 Nov 11 17:15:21.986569 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f487928f-55f3-4fab-a504-79f8def2501f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=511efbbe-6191-40d0-b89d-4f5291e031c8,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:21.988982 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57780) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:22.039167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e463072d-a283-4018-b2dd-e416073d5485 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:22.064476 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e463072d-a283-4018-b2dd-e416073d5485 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:22.206804 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e463072d-a283-4018-b2dd-e416073d5485 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:22.209506 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e463072d-a283-4018-b2dd-e416073d5485 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:22.210669 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-e463072d-a283-4018-b2dd-e416073d5485 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/511efbbe-6191-40d0-b89d-4f5291e031c8 HTTP/1.1" status: 204 len: 168 time: 0.2206810 Nov 11 17:15:22.219415 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e463072d-a283-4018-b2dd-e416073d5485 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=511efbbe-6191-40d0-b89d-4f5291e031c8,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:22.791134 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57794) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:22.812848 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-25803b3c-7c6c-4d27-b165-cf17d7b80116 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:22.875427 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca5c9bc-0615-424a-95b1-ed39f241230e req-05d32cdb-4159-40f5-a4c1-86ad3674aac0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:22.877005 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cca5c9bc-0615-424a-95b1-ed39f241230e req-05d32cdb-4159-40f5-a4c1-86ad3674aac0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0794590 Nov 11 17:15:22.951261 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cca5c9bc-0615-424a-95b1-ed39f241230e req-0ec8fff6-5d90-45d6-bfa2-8e96d438c1c7 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0648487 Nov 11 17:15:22.964882 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-25803b3c-7c6c-4d27-b165-cf17d7b80116 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:23.035215 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-25803b3c-7c6c-4d27-b165-cf17d7b80116 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:23.074944 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-25803b3c-7c6c-4d27-b165-cf17d7b80116 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=9cedd31d960d4572bbae4219521823ba&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2825584 Nov 11 17:15:23.075962 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25803b3c-7c6c-4d27-b165-cf17d7b80116 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ed51ca1-06a7-4591-b98e-1d6718e412c4,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:23.078930 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57802) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:23.130901 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-edf6acc7-be86-41c3-9c86-4206040408db admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:23.151902 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-edf6acc7-be86-41c3-9c86-4206040408db admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:23.257906 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-edf6acc7-be86-41c3-9c86-4206040408db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:23.261125 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-edf6acc7-be86-41c3-9c86-4206040408db admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:23.262265 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-edf6acc7-be86-41c3-9c86-4206040408db admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/0ed51ca1-06a7-4591-b98e-1d6718e412c4 HTTP/1.1" status: 204 len: 168 time: 0.1824334 Nov 11 17:15:23.270040 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edf6acc7-be86-41c3-9c86-4206040408db admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ed51ca1-06a7-4591-b98e-1d6718e412c4,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:23.323920 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57808) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:23.340865 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-542f6b89-0c9d-43c1-9f0a-b2b16dc182c5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:23.438266 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-542f6b89-0c9d-43c1-9f0a-b2b16dc182c5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:23.537992 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-542f6b89-0c9d-43c1-9f0a-b2b16dc182c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:23.576258 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-542f6b89-0c9d-43c1-9f0a-b2b16dc182c5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=68028251-b8bf-4d8e-828a-d3d9c6f3f061,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:23.580891 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-542f6b89-0c9d-43c1-9f0a-b2b16dc182c5 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=384b6e03ed0046efb2dcdfce05e45369&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2558348 Nov 11 17:15:23.583684 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 57816) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:23.632103 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-6d21c38b-3d69-4f95-88ff-3a3691e68c41 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:23.653221 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-6d21c38b-3d69-4f95-88ff-3a3691e68c41 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:23.795054 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-6d21c38b-3d69-4f95-88ff-3a3691e68c41 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:23.797647 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-6d21c38b-3d69-4f95-88ff-3a3691e68c41 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:23.798800 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-6d21c38b-3d69-4f95-88ff-3a3691e68c41 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/68028251-b8bf-4d8e-828a-d3d9c6f3f061 HTTP/1.1" status: 204 len: 168 time: 0.2141206 Nov 11 17:15:23.807830 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d21c38b-3d69-4f95-88ff-3a3691e68c41 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=68028251-b8bf-4d8e-828a-d3d9c6f3f061,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:24.074035 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7862370f-274c-4cfa-92e9-09d06c92bfaf req-e896a493-7ae6-4304-a802-0f2348ef1078 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:24.079069 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7862370f-274c-4cfa-92e9-09d06c92bfaf req-e896a493-7ae6-4304-a802-0f2348ef1078 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0548954 Nov 11 17:15:24.134113 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7862370f-274c-4cfa-92e9-09d06c92bfaf req-e5509681-33e0-4d1d-a855-1b33ca73154e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524752 Nov 11 17:15:25.259105 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae7066f-5a23-4215-b034-a2df57754ebc req-5a8280c0-24af-4b06-8579-960b33ebb085 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:25.261162 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bae7066f-5a23-4215-b034-a2df57754ebc req-5a8280c0-24af-4b06-8579-960b33ebb085 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0511212 Nov 11 17:15:25.308987 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bae7066f-5a23-4215-b034-a2df57754ebc req-8d683e63-c9e9-4bd5-87b0-f2b8838d019e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415504 Nov 11 17:15:26.425472 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9fa3af5-ec52-41fc-8687-b14fca6da1ae req-d22742e4-baa8-4e0a-af16-ef262b4fbce8 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:26.426529 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a9fa3af5-ec52-41fc-8687-b14fca6da1ae req-d22742e4-baa8-4e0a-af16-ef262b4fbce8 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0488186 Nov 11 17:15:26.482791 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a9fa3af5-ec52-41fc-8687-b14fca6da1ae req-80ebd120-6cbf-497c-b910-2ffcc2a3f0d3 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495398 Nov 11 17:15:27.604490 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd122aaf-2ee4-4d00-934d-b918225bdfa8 req-831ea82f-fc44-466e-9a00-14d54b9cf14b tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:27.605838 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bd122aaf-2ee4-4d00-934d-b918225bdfa8 req-831ea82f-fc44-466e-9a00-14d54b9cf14b tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0502405 Nov 11 17:15:27.653159 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bd122aaf-2ee4-4d00-934d-b918225bdfa8 req-fa24a262-b9e2-4d42-8549-c7d1865ee55e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413253 Nov 11 17:15:27.742800 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58004) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:27.845491 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e5582889-7d3f-4a8e-9643-834203da9613 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:27.924270 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e5582889-7d3f-4a8e-9643-834203da9613 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:28.006756 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e5582889-7d3f-4a8e-9643-834203da9613 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:28.043222 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5582889-7d3f-4a8e-9643-834203da9613 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=658e65ba-304a-423c-9963-5536586264e2,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:28.047442 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-e5582889-7d3f-4a8e-9643-834203da9613 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=b705ffdb92b94b20a00f6cf12b427ed4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3034155 Nov 11 17:15:28.050050 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58008) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:28.095734 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-8119e7a8-7a1d-414c-85a6-d943912a6a48 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:28.116757 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-8119e7a8-7a1d-414c-85a6-d943912a6a48 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:28.240637 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-8119e7a8-7a1d-414c-85a6-d943912a6a48 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:28.243231 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-8119e7a8-7a1d-414c-85a6-d943912a6a48 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:28.244400 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-8119e7a8-7a1d-414c-85a6-d943912a6a48 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/658e65ba-304a-423c-9963-5536586264e2 HTTP/1.1" status: 204 len: 168 time: 0.1934211 Nov 11 17:15:28.252663 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8119e7a8-7a1d-414c-85a6-d943912a6a48 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=658e65ba-304a-423c-9963-5536586264e2,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:28.764407 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6daee3-00db-4b84-97c3-2692bbd8593b req-1b6f3ee1-af72-4a67-b81a-5e10937d293e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:28.765798 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ec6daee3-00db-4b84-97c3-2692bbd8593b req-1b6f3ee1-af72-4a67-b81a-5e10937d293e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0468380 Nov 11 17:15:28.820714 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ec6daee3-00db-4b84-97c3-2692bbd8593b req-f0608746-0831-454c-95e6-414ff81c3e78 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489633 Nov 11 17:15:29.007084 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 58026) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:29.020361 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-907471b4-fcb7-41e6-b2d7-3e8c2f493e61 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:29.097015 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-907471b4-fcb7-41e6-b2d7-3e8c2f493e61 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:29.183733 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-907471b4-fcb7-41e6-b2d7-3e8c2f493e61 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:29.229491 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-907471b4-fcb7-41e6-b2d7-3e8c2f493e61 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=2cca5c92f2fd4818898a3c4ee58b0548&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2163391 Nov 11 17:15:29.229491 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-907471b4-fcb7-41e6-b2d7-3e8c2f493e61 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4d1b952-03c1-4771-ab8d-9a0409a162ae,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:29.230985 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 58034) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:29.288240 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b2ad60cf-5b84-49d2-a63f-481c8673bdb9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:29.309638 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b2ad60cf-5b84-49d2-a63f-481c8673bdb9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:29.515609 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b2ad60cf-5b84-49d2-a63f-481c8673bdb9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:29.518506 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b2ad60cf-5b84-49d2-a63f-481c8673bdb9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:29.519905 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-b2ad60cf-5b84-49d2-a63f-481c8673bdb9 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/d4d1b952-03c1-4771-ab8d-9a0409a162ae HTTP/1.1" status: 204 len: 168 time: 0.2879972 Nov 11 17:15:29.528377 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2ad60cf-5b84-49d2-a63f-481c8673bdb9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4d1b952-03c1-4771-ab8d-9a0409a162ae,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:29.961402 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c58754e8-cd61-449a-8125-8ba1a9fd18d2 req-3a15d861-961c-41ff-99da-7861ac824e3d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:29.964567 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c58754e8-cd61-449a-8125-8ba1a9fd18d2 req-3a15d861-961c-41ff-99da-7861ac824e3d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0697885 Nov 11 17:15:30.047225 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c58754e8-cd61-449a-8125-8ba1a9fd18d2 req-a3dfde6d-c80d-4a77-a4d3-12ced0220f9f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688124 Nov 11 17:15:30.475182 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 58094) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:30.524333 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_v2 [None req-344dbe14-1dad-4d9a-b943-f7084f5d107c admin admin] Deleting subnet 316bc385-cbc0-473d-9c75-638fd92e1189 {{(pid=102324) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:15:30.529410 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-344dbe14-1dad-4d9a-b943-f7084f5d107c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:30.567492 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-344dbe14-1dad-4d9a-b943-f7084f5d107c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5895837'] for subnet, precommit_delete_associations {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:30.606044 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-344dbe14-1dad-4d9a-b943-f7084f5d107c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:30.745260 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-344dbe14-1dad-4d9a-b943-f7084f5d107c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5436208', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5275461'] for subnet, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:30.771831 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-344dbe14-1dad-4d9a-b943-f7084f5d107c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=316bc385-cbc0-473d-9c75-638fd92e1189,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:30.776275 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-344dbe14-1dad-4d9a-b943-f7084f5d107c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:30.779556 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-344dbe14-1dad-4d9a-b943-f7084f5d107c admin admin] 10.222.0.16 "DELETE /v2.0/subnets/316bc385-cbc0-473d-9c75-638fd92e1189 HTTP/1.1" status: 204 len: 168 time: 0.3031523 Nov 11 17:15:30.784212 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 58104) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:30.862815 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e088f36f-d368-4cac-8a89-f2fa9490cbba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:30.907548 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58110) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:31.060096 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-56f67d49-db6b-471b-8a83-29a25e0aa07f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.157722 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e088f36f-d368-4cac-8a89-f2fa9490cbba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.195537 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-75fd886a-0dec-4a1d-8a72-c607a61ca564 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.203430 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-e088f36f-d368-4cac-8a89-f2fa9490cbba admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6def8382-3fac-4ffe-a290-cdf6af09b51a']}} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:15:31.216999 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-e088f36f-d368-4cac-8a89-f2fa9490cbba admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f4b7462a-aeae-466c-b287-1d035a39e842') {'for_net_delete': True} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:15:31.217561 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-e088f36f-d368-4cac-8a89-f2fa9490cbba admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f4b7462a-aeae-466c-b287-1d035a39e842') {} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:15:31.230159 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e088f36f-d368-4cac-8a89-f2fa9490cbba admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5895812'] for segment, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.247915 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e7c722-662a-45d6-a1d9-8f0c9529648e req-1d73c2c0-fa9e-45ce-8fd3-52c9708ffe33 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:31.249377 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-70e7c722-662a-45d6-a1d9-8f0c9529648e req-1d73c2c0-fa9e-45ce-8fd3-52c9708ffe33 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0960057 Nov 11 17:15:31.255758 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e088f36f-d368-4cac-8a89-f2fa9490cbba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.268427 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e088f36f-d368-4cac-8a89-f2fa9490cbba admin admin] Releasing vlan 548 on physical network physnet1 to pool {{(pid=102324) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:15:31.268818 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e088f36f-d368-4cac-8a89-f2fa9490cbba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5436270'] for segment, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: Traceback (most recent call last): Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: timer() Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: cb(*args, **kw) Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: return func(*args, **kwargs) Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: self._notify() Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: self.callback(batched_events) Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: event.method(event) Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: return f(self, *a, **k) Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: return self._get(url).json() Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: return self.request(url, 'GET', **kwargs) Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:15:31.271295 dv-cinder-694140-2-iscsi neutron-server[102324]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:15:31.277307 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-75fd886a-0dec-4a1d-8a72-c607a61ca564 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.349617 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-75fd886a-0dec-4a1d-8a72-c607a61ca564 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.350580 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-70e7c722-662a-45d6-a1d9-8f0c9529648e req-595633e4-0fe2-4fbf-be63-560daf067dbb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0922816 Nov 11 17:15:31.390373 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-75fd886a-0dec-4a1d-8a72-c607a61ca564 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=2fb389bd85d14905b8fb1a86aa955154&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4812508 Nov 11 17:15:31.391770 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75fd886a-0dec-4a1d-8a72-c607a61ca564 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9e77c51-050b-4127-8a79-f59e42081e7f,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:31.393217 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 58130) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:31.461844 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e088f36f-d368-4cac-8a89-f2fa9490cbba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.471339 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b23ff509-bbb5-4abf-b01c-ddf53e5845f0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.473267 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e088f36f-d368-4cac-8a89-f2fa9490cbba admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.479329 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-e088f36f-d368-4cac-8a89-f2fa9490cbba admin admin] 10.222.0.16 "DELETE /v2.0/networks/6def8382-3fac-4ffe-a290-cdf6af09b51a HTTP/1.1" status: 204 len: 168 time: 0.6938224 Nov 11 17:15:31.479564 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58138) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:31.491587 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e088f36f-d368-4cac-8a89-f2fa9490cbba admin admin] Pushing event deleted for resources: {'Network': ['ID=6def8382-3fac-4ffe-a290-cdf6af09b51a,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:31.514026 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b23ff509-bbb5-4abf-b01c-ddf53e5845f0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.526655 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_v2 [None req-bcfe50e5-32cd-4f46-b1d5-c4e144317863 admin admin] Deleting subnet 44381945-e316-4a03-9daa-6b6430f32c25 {{(pid=102323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:15:31.530128 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bcfe50e5-32cd-4f46-b1d5-c4e144317863 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.569916 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bcfe50e5-32cd-4f46-b1d5-c4e144317863 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5777079'] for subnet, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.617890 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bcfe50e5-32cd-4f46-b1d5-c4e144317863 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.677928 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58144) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:31.692889 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b23ff509-bbb5-4abf-b01c-ddf53e5845f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.695696 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b23ff509-bbb5-4abf-b01c-ddf53e5845f0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.697025 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-b23ff509-bbb5-4abf-b01c-ddf53e5845f0 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/c9e77c51-050b-4127-8a79-f59e42081e7f HTTP/1.1" status: 204 len: 168 time: 0.3019173 Nov 11 17:15:31.708068 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b23ff509-bbb5-4abf-b01c-ddf53e5845f0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9e77c51-050b-4127-8a79-f59e42081e7f,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:31.784031 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bcfe50e5-32cd-4f46-b1d5-c4e144317863 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5720643', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5388326'] for subnet, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.821208 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcfe50e5-32cd-4f46-b1d5-c4e144317863 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=44381945-e316-4a03-9daa-6b6430f32c25,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:31.824470 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7a2a6ec3-e5e1-4e77-ad8e-11a0b3306209 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.827435 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bcfe50e5-32cd-4f46-b1d5-c4e144317863 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.830035 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-bcfe50e5-32cd-4f46-b1d5-c4e144317863 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/44381945-e316-4a03-9daa-6b6430f32c25 HTTP/1.1" status: 204 len: 168 time: 0.3493729 Nov 11 17:15:31.834607 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 58150) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:31.934174 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-678e9d51-4bb7-48b0-aca2-f25cc1cb9630 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:31.959230 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7a2a6ec3-e5e1-4e77-ad8e-11a0b3306209 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.023354 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-678e9d51-4bb7-48b0-aca2-f25cc1cb9630 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.024109 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7a2a6ec3-e5e1-4e77-ad8e-11a0b3306209 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.047016 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-678e9d51-4bb7-48b0-aca2-f25cc1cb9630 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['29f820c4-01b9-4916-8606-a6708295ba3a']}} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:15:32.066968 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-678e9d51-4bb7-48b0-aca2-f25cc1cb9630 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0b5f6b16-509e-4202-9747-664f53d0183d') {'for_net_delete': True} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:15:32.067783 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-678e9d51-4bb7-48b0-aca2-f25cc1cb9630 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0b5f6b16-509e-4202-9747-664f53d0183d') {} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:15:32.072281 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-7a2a6ec3-e5e1-4e77-ad8e-11a0b3306209 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=c15a08acc3184459970277000d93c9a9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3931706 Nov 11 17:15:32.073598 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a2a6ec3-e5e1-4e77-ad8e-11a0b3306209 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60035194-237d-4d17-bcfe-28fbe20982a5,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:32.076103 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58158) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:32.088509 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-678e9d51-4bb7-48b0-aca2-f25cc1cb9630 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5895812'] for segment, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.106934 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-678e9d51-4bb7-48b0-aca2-f25cc1cb9630 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.124667 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-678e9d51-4bb7-48b0-aca2-f25cc1cb9630 admin admin] Releasing vlan 508 on physical network physnet1 to pool {{(pid=102324) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:15:32.125067 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-678e9d51-4bb7-48b0-aca2-f25cc1cb9630 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5436270'] for segment, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: Traceback (most recent call last): Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: timer() Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: cb(*args, **kw) Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: return func(*args, **kwargs) Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: self._notify() Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: self.callback(batched_events) Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: event.method(event) Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: return f(self, *a, **k) Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: return self._get(url).json() Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: return self.request(url, 'GET', **kwargs) Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:15:32.126850 dv-cinder-694140-2-iscsi neutron-server[102324]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:15:32.140800 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d5784ebe-c446-4e66-bea7-35e2d9ce7828 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.161974 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d5784ebe-c446-4e66-bea7-35e2d9ce7828 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.297946 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-678e9d51-4bb7-48b0-aca2-f25cc1cb9630 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.303580 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-678e9d51-4bb7-48b0-aca2-f25cc1cb9630 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.308190 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-678e9d51-4bb7-48b0-aca2-f25cc1cb9630 admin admin] 10.222.0.16 "DELETE /v2.0/networks/29f820c4-01b9-4916-8606-a6708295ba3a HTTP/1.1" status: 204 len: 168 time: 0.4723234 Nov 11 17:15:32.318558 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-678e9d51-4bb7-48b0-aca2-f25cc1cb9630 admin admin] Pushing event deleted for resources: {'Network': ['ID=29f820c4-01b9-4916-8606-a6708295ba3a,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:32.413868 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d5784ebe-c446-4e66-bea7-35e2d9ce7828 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.414933 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d5784ebe-c446-4e66-bea7-35e2d9ce7828 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.419053 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-d5784ebe-c446-4e66-bea7-35e2d9ce7828 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/60035194-237d-4d17-bcfe-28fbe20982a5 HTTP/1.1" status: 204 len: 168 time: 0.3389721 Nov 11 17:15:32.425064 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5784ebe-c446-4e66-bea7-35e2d9ce7828 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60035194-237d-4d17-bcfe-28fbe20982a5,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:32.471400 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e13b7f10-f108-4300-bb2e-537fd428cb10 req-d2f9231b-0778-40cd-b470-773999902330 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:32.472924 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e13b7f10-f108-4300-bb2e-537fd428cb10 req-d2f9231b-0778-40cd-b470-773999902330 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0527132 Nov 11 17:15:32.524744 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e13b7f10-f108-4300-bb2e-537fd428cb10 req-b8ba0aec-ab27-4f6a-a9d5-86750aec025e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460005 Nov 11 17:15:32.555442 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58166) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:32.574644 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ae003623-65e6-4031-bafd-fefcdf66e50f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.671429 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ae003623-65e6-4031-bafd-fefcdf66e50f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.692265 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58176) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:32.747191 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-0ce29614-b18f-48ed-b076-3038211dc86c admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=62e88ea9868543be9ea642bd11db4961&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0536220 Nov 11 17:15:32.748173 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58182) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:32.760370 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ae003623-65e6-4031-bafd-fefcdf66e50f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.820591 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-ae003623-65e6-4031-bafd-fefcdf66e50f admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=ca5ef15dfcf040978a77e5cee0b58952&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2640254 Nov 11 17:15:32.821699 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae003623-65e6-4031-bafd-fefcdf66e50f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6b9d47ba-f74f-488a-bc88-628964dd8ca1,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:32.823413 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 58184) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:32.840663 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-2385890d-6c2a-46d5-8625-2821626f3676 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.862888 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-2385890d-6c2a-46d5-8625-2821626f3676 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.873116 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-31320535-c770-44f1-940d-f5fdfa6e9d82 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:32.894332 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-31320535-c770-44f1-940d-f5fdfa6e9d82 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:33.001056 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-2385890d-6c2a-46d5-8625-2821626f3676 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:33.003725 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-2385890d-6c2a-46d5-8625-2821626f3676 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:33.004855 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-2385890d-6c2a-46d5-8625-2821626f3676 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/c21fb1c4-038e-468a-8603-a115acf47197 HTTP/1.1" status: 204 len: 168 time: 0.2557817 Nov 11 17:15:33.013164 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2385890d-6c2a-46d5-8625-2821626f3676 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c21fb1c4-038e-468a-8603-a115acf47197,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:33.022372 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-31320535-c770-44f1-940d-f5fdfa6e9d82 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:33.027176 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-31320535-c770-44f1-940d-f5fdfa6e9d82 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:33.028515 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-31320535-c770-44f1-940d-f5fdfa6e9d82 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/6b9d47ba-f74f-488a-bc88-628964dd8ca1 HTTP/1.1" status: 204 len: 168 time: 0.2040639 Nov 11 17:15:33.040180 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31320535-c770-44f1-940d-f5fdfa6e9d82 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b9d47ba-f74f-488a-bc88-628964dd8ca1,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:33.526756 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-79cdbf6a-572e-4950-93ba-aa68ba818cbd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:33.643057 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b9de306-5951-4886-9c9c-f663bf7dc651 req-d1e09d9f-6417-4917-9393-61e8655902a7 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:33.647227 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6b9de306-5951-4886-9c9c-f663bf7dc651 req-d1e09d9f-6417-4917-9393-61e8655902a7 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0515258 Nov 11 17:15:33.692504 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6b9de306-5951-4886-9c9c-f663bf7dc651 req-524b5545-b1ac-4303-9b05-969fb324a942 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420935 Nov 11 17:15:33.760648 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 58216) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:33.805546 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-2695f07b-29d3-4371-b063-35f5a82a8c00 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=e76706615e434c6083c33022dc1a2a93&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0436814 Nov 11 17:15:33.808687 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58220) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:33.872672 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-69c92c00-4a11-4359-bfb3-e41ae548543d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:33.894882 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-69c92c00-4a11-4359-bfb3-e41ae548543d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:34.040618 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-69c92c00-4a11-4359-bfb3-e41ae548543d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:34.043382 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-69c92c00-4a11-4359-bfb3-e41ae548543d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:34.044513 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-69c92c00-4a11-4359-bfb3-e41ae548543d admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/a92c4537-58d9-4e02-aee7-5206c9ba7dd6 HTTP/1.1" status: 204 len: 168 time: 0.2343268 Nov 11 17:15:34.052330 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69c92c00-4a11-4359-bfb3-e41ae548543d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a92c4537-58d9-4e02-aee7-5206c9ba7dd6,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:34.595228 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:34.829849 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd58698-5850-4ff6-9ad5-74aaffa75c82 req-37ab9871-ba54-4494-8aff-20366581da10 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:34.840134 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5bd58698-5850-4ff6-9ad5-74aaffa75c82 req-37ab9871-ba54-4494-8aff-20366581da10 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0752192 Nov 11 17:15:34.893131 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5bd58698-5850-4ff6-9ad5-74aaffa75c82 req-1c48129b-13dc-4216-ae34-3bd4556fd3c4 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517817 Nov 11 17:15:36.018264 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b67d91ae-675c-4868-ac40-7c2bc7640ab2 req-9b13dde3-f17c-4f84-9f8b-a72072fd719f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:36.021536 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b67d91ae-675c-4868-ac40-7c2bc7640ab2 req-9b13dde3-f17c-4f84-9f8b-a72072fd719f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0569751 Nov 11 17:15:36.071937 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b67d91ae-675c-4868-ac40-7c2bc7640ab2 req-4ffc6200-7148-4315-a4e5-a4ea3e3b2007 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434723 Nov 11 17:15:36.297850 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:37.080685 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:37.201153 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee65e999-c8af-4998-96e0-ae242a8119dd req-ccbfa54f-8dcd-4f63-9d44-58993fc829a3 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:37.201153 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ee65e999-c8af-4998-96e0-ae242a8119dd req-ccbfa54f-8dcd-4f63-9d44-58993fc829a3 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0557206 Nov 11 17:15:37.251084 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ee65e999-c8af-4998-96e0-ae242a8119dd req-ad4b1e59-86e3-4c8f-a787-5fd15487cd7e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459588 Nov 11 17:15:38.386099 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49d57230-f361-42a8-8a24-dfe146847933 req-3dba688c-9ff1-4998-8b19-bfdf44191e6a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:38.387611 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-49d57230-f361-42a8-8a24-dfe146847933 req-3dba688c-9ff1-4998-8b19-bfdf44191e6a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0552945 Nov 11 17:15:38.436612 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-49d57230-f361-42a8-8a24-dfe146847933 req-c925e9d9-5727-4dc8-b938-7b10249d2c56 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419221 Nov 11 17:15:39.555858 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db5d5611-d506-4609-be32-98894019ba57 req-8ba96c5f-5c9a-4fed-a3b5-8e7179b7f9b9 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:39.558115 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-db5d5611-d506-4609-be32-98894019ba57 req-8ba96c5f-5c9a-4fed-a3b5-8e7179b7f9b9 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0529866 Nov 11 17:15:39.621037 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-db5d5611-d506-4609-be32-98894019ba57 req-b5acd41a-faad-4749-8387-67b7ba64a030 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0555868 Nov 11 17:15:40.429603 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58440) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:40.538155 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a57b0dac-83c3-43d8-9ede-61f6598b6dac admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:40.614318 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a57b0dac-83c3-43d8-9ede-61f6598b6dac admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:40.692195 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a57b0dac-83c3-43d8-9ede-61f6598b6dac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:40.737560 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-a57b0dac-83c3-43d8-9ede-61f6598b6dac admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=e371a68de0414ffda6dd74bcbe6b8d09&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3067379 Nov 11 17:15:40.738184 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 58460) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:40.738749 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a57b0dac-83c3-43d8-9ede-61f6598b6dac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c96ea242-2b04-4cff-ba20-cf9cb6a20227,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:40.779744 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d3025d7-0d06-432d-9206-9971eb2a3b97 req-acf7ce79-5e01-4188-8d0e-8e26a5733250 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:40.781244 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8d3025d7-0d06-432d-9206-9971eb2a3b97 req-acf7ce79-5e01-4188-8d0e-8e26a5733250 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0770631 Nov 11 17:15:40.825671 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5d2e1e90-b4a9-4a58-8811-edc58265d1cb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:40.856618 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8d3025d7-0d06-432d-9206-9971eb2a3b97 req-8e3f8ef8-ce78-430b-89e5-f08a2eaa3a8e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0669100 Nov 11 17:15:40.861221 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5d2e1e90-b4a9-4a58-8811-edc58265d1cb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:41.006461 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5d2e1e90-b4a9-4a58-8811-edc58265d1cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:41.009013 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5d2e1e90-b4a9-4a58-8811-edc58265d1cb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:41.010210 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-5d2e1e90-b4a9-4a58-8811-edc58265d1cb admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/c96ea242-2b04-4cff-ba20-cf9cb6a20227 HTTP/1.1" status: 204 len: 168 time: 0.2701077 Nov 11 17:15:41.018402 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d2e1e90-b4a9-4a58-8811-edc58265d1cb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c96ea242-2b04-4cff-ba20-cf9cb6a20227,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:41.669057 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 58476) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:41.682097 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-8fb5f730-b598-4f10-ae05-5c5e2ad73b54 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:41.758965 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-8fb5f730-b598-4f10-ae05-5c5e2ad73b54 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:41.828901 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-8fb5f730-b598-4f10-ae05-5c5e2ad73b54 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:41.868014 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-8fb5f730-b598-4f10-ae05-5c5e2ad73b54 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=df8f6a9cc4c6440caa1ebd9bca7a1f24&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1978428 Nov 11 17:15:41.868863 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb5f730-b598-4f10-ae05-5c5e2ad73b54 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=479d8557-93ae-4ad0-aed0-684e82dfdbc4,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:41.870738 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58478) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:41.923057 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-49784208-8e53-4624-84cd-ff7acaf1dbe2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:41.944769 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-49784208-8e53-4624-84cd-ff7acaf1dbe2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:41.970739 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09258eab-e6fe-4327-a4a9-361be7a601ed req-64719ab7-041a-4a65-aaee-5ab55539deb7 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:41.972238 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-09258eab-e6fe-4327-a4a9-361be7a601ed req-64719ab7-041a-4a65-aaee-5ab55539deb7 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0480180 Nov 11 17:15:42.021151 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-09258eab-e6fe-4327-a4a9-361be7a601ed req-e117603f-05d5-4966-a506-d74c15f67d6d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426280 Nov 11 17:15:42.069443 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-49784208-8e53-4624-84cd-ff7acaf1dbe2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:42.072400 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-49784208-8e53-4624-84cd-ff7acaf1dbe2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:42.076513 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-49784208-8e53-4624-84cd-ff7acaf1dbe2 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/479d8557-93ae-4ad0-aed0-684e82dfdbc4 HTTP/1.1" status: 204 len: 168 time: 0.2017331 Nov 11 17:15:42.081652 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49784208-8e53-4624-84cd-ff7acaf1dbe2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=479d8557-93ae-4ad0-aed0-684e82dfdbc4,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:43.145886 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f18d66ac-4417-4f0f-8b18-07bc79996bd7 req-92b50d72-4db1-4992-a909-df1ec485d867 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:43.148082 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f18d66ac-4417-4f0f-8b18-07bc79996bd7 req-92b50d72-4db1-4992-a909-df1ec485d867 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0520701 Nov 11 17:15:43.201809 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f18d66ac-4417-4f0f-8b18-07bc79996bd7 req-ef9e7237-d5e0-4e58-94f9-e66e8146c55c tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470269 Nov 11 17:15:43.531699 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf1cae99-49f5-4f52-ac36-b82c4d658ea5 req-0a1eba59-1bae-4396-8d7b-d54021e67e16 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:43.531699 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-cf1cae99-49f5-4f52-ac36-b82c4d658ea5 req-0a1eba59-1bae-4396-8d7b-d54021e67e16 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 1098 time: 0.0572844 Nov 11 17:15:43.603141 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-cf1cae99-49f5-4f52-ac36-b82c4d658ea5 req-592acb3d-dbbc-4cf4-a105-6b9a1129e2ee service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0624576 Nov 11 17:15:44.318899 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba2a0c17-fcd3-4e6d-96be-d9825d805ff9 req-87ffec9b-bb2f-4e23-9945-6e97fdde8043 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:44.320384 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ba2a0c17-fcd3-4e6d-96be-d9825d805ff9 req-87ffec9b-bb2f-4e23-9945-6e97fdde8043 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0528104 Nov 11 17:15:44.369970 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ba2a0c17-fcd3-4e6d-96be-d9825d805ff9 req-46306b9c-6086-4030-87a4-b097cd2f494f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429304 Nov 11 17:15:45.483599 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d7693c-4a58-431e-8856-96b6479d2a60 req-9d119a86-ef93-4ef7-8cfd-7f928c318513 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:45.485105 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-73d7693c-4a58-431e-8856-96b6479d2a60 req-9d119a86-ef93-4ef7-8cfd-7f928c318513 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0475409 Nov 11 17:15:45.535338 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-73d7693c-4a58-431e-8856-96b6479d2a60 req-5747156f-66b5-4295-873f-60dcfc5a0114 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426924 Nov 11 17:15:46.657316 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9470fda-0806-4550-a5f9-e47906fc4575 req-6aff1414-a791-4fd8-be7d-b5ff320f1550 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:46.658794 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b9470fda-0806-4550-a5f9-e47906fc4575 req-6aff1414-a791-4fd8-be7d-b5ff320f1550 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0508342 Nov 11 17:15:46.712156 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b9470fda-0806-4550-a5f9-e47906fc4575 req-7234e8eb-4e88-4786-a076-24fa45400f80 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471761 Nov 11 17:15:46.817548 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:47.826691 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29705f6b-32e9-46dc-80bc-5c91fa137346 req-26f7b261-a9cb-4831-871f-f46002bd9e95 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:47.828260 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-29705f6b-32e9-46dc-80bc-5c91fa137346 req-26f7b261-a9cb-4831-871f-f46002bd9e95 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0484090 Nov 11 17:15:47.876173 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-29705f6b-32e9-46dc-80bc-5c91fa137346 req-1d7515f0-0e56-4be9-ba24-40e74cb44e11 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413203 Nov 11 17:15:47.997251 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee483b6-cebf-4841-b799-96bdba6a8778 req-4f7b144f-2f3a-4688-bdd4-4f45888b4602 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:47.998727 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-3ee483b6-cebf-4841-b799-96bdba6a8778 req-4f7b144f-2f3a-4688-bdd4-4f45888b4602 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0509520 Nov 11 17:15:48.046744 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-3ee483b6-cebf-4841-b799-96bdba6a8778 req-1d05c5d0-6362-43d7-bf36-3365cdd11594 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420971 Nov 11 17:15:50.582103 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58718) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:50.700616 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f30984fe-61a8-486d-8c15-6c35fbd31886 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:50.790476 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f30984fe-61a8-486d-8c15-6c35fbd31886 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:50.920893 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f30984fe-61a8-486d-8c15-6c35fbd31886 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:50.968101 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 58732) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:50.968756 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-f30984fe-61a8-486d-8c15-6c35fbd31886 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=102434f074a04b5e91fe0207fa3dd177&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3835571 Nov 11 17:15:50.969326 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f30984fe-61a8-486d-8c15-6c35fbd31886 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=845b52e8-dbca-4ab0-a816-3b053ddca6f1,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:51.030023 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-26e1502a-46e6-45a9-847a-e951738fd054 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:51.064413 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9851210c-81b7-469b-bd52-a1bc52e36f53 req-59731a63-89d6-40c7-94ea-71008117dfa5 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:51.066195 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9851210c-81b7-469b-bd52-a1bc52e36f53 req-59731a63-89d6-40c7-94ea-71008117dfa5 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0508428 Nov 11 17:15:51.074598 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-26e1502a-46e6-45a9-847a-e951738fd054 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:51.161444 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9851210c-81b7-469b-bd52-a1bc52e36f53 req-8917015b-2dc7-4997-9aba-ca035b84385c tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0879214 Nov 11 17:15:51.175163 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f386bb7-2b3b-4c97-91d0-a03181dd4af7 req-08ecefaf-b677-41da-b5b1-682ff951ddc2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:51.176797 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0f386bb7-2b3b-4c97-91d0-a03181dd4af7 req-08ecefaf-b677-41da-b5b1-682ff951ddc2 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ed26d137d98846b9b45708f7e581e9b0&device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 1098 time: 0.0585935 Nov 11 17:15:51.273882 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f386bb7-2b3b-4c97-91d0-a03181dd4af7 req-f0781bbe-f503-4696-bf46-a9b9557ff541 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:51.275354 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0f386bb7-2b3b-4c97-91d0-a03181dd4af7 req-f0781bbe-f503-4696-bf46-a9b9557ff541 service neutron] 10.222.0.10 "GET /v2.0/networks?id=983bda4c-112d-442d-b37a-387818bb1d45 HTTP/1.1" status: 200 len: 919 time: 0.0894372 Nov 11 17:15:51.291866 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-26e1502a-46e6-45a9-847a-e951738fd054 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:51.295586 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-26e1502a-46e6-45a9-847a-e951738fd054 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:51.296718 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-26e1502a-46e6-45a9-847a-e951738fd054 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/845b52e8-dbca-4ab0-a816-3b053ddca6f1 HTTP/1.1" status: 204 len: 168 time: 0.3276193 Nov 11 17:15:51.297362 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 58740) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:51.310627 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26e1502a-46e6-45a9-847a-e951738fd054 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=845b52e8-dbca-4ab0-a816-3b053ddca6f1,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:51.333840 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0f386bb7-2b3b-4c97-91d0-a03181dd4af7 req-6305fbb6-95c6-4cfd-8b93-935aa205ec3b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=904b538c-2fcd-42a3-bc02-26c84d4d00cb HTTP/1.1" status: 200 len: 217 time: 0.0414891 Nov 11 17:15:51.405849 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f386bb7-2b3b-4c97-91d0-a03181dd4af7 req-173ca7fb-9ead-4a6d-80c1-b729c26d90b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:51.405849 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0f386bb7-2b3b-4c97-91d0-a03181dd4af7 req-173ca7fb-9ead-4a6d-80c1-b729c26d90b7 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4 HTTP/1.1" status: 200 len: 858 time: 0.0550339 Nov 11 17:15:51.439156 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5af2cf80-16ee-4926-83ed-727ac75d53ba admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:51.468827 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0f386bb7-2b3b-4c97-91d0-a03181dd4af7 req-883b508e-61d6-44f9-888e-cf126cbb77d6 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=983bda4c-112d-442d-b37a-387818bb1d45&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0440016 Nov 11 17:15:51.578689 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0f386bb7-2b3b-4c97-91d0-a03181dd4af7 req-329a4635-cd75-4a19-89b3-772290766425 service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0981653 Nov 11 17:15:51.625198 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5af2cf80-16ee-4926-83ed-727ac75d53ba admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:51.690265 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0f386bb7-2b3b-4c97-91d0-a03181dd4af7 req-d2fa3735-298e-43fb-9d5b-5f1bb8a86e7d service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0996594 Nov 11 17:15:51.725394 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5af2cf80-16ee-4926-83ed-727ac75d53ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:51.764690 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-5af2cf80-16ee-4926-83ed-727ac75d53ba admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=72534932c4f54edda4799fb2bfd2fe7b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4616199 Nov 11 17:15:51.768884 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58774) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:51.790244 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5af2cf80-16ee-4926-83ed-727ac75d53ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0de4d01c-a16f-444a-b069-d9318039d5e7,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:51.830856 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f5df42d3-e639-427c-bf23-983e58d6acc3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:51.861712 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f5df42d3-e639-427c-bf23-983e58d6acc3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:51.945696 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58784) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:52.000541 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f5df42d3-e639-427c-bf23-983e58d6acc3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.003379 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f5df42d3-e639-427c-bf23-983e58d6acc3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.004551 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-f5df42d3-e639-427c-bf23-983e58d6acc3 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/0de4d01c-a16f-444a-b069-d9318039d5e7 HTTP/1.1" status: 204 len: 168 time: 0.2345853 Nov 11 17:15:52.013634 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5df42d3-e639-427c-bf23-983e58d6acc3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0de4d01c-a16f-444a-b069-d9318039d5e7,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:52.059721 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4cc96925-da9f-455a-ab3b-8a0727e69fc1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.159360 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4cc96925-da9f-455a-ab3b-8a0727e69fc1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.237213 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58794) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:52.263649 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b9fa5731-e23d-4fda-aab3-1adcf8242fa7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.279918 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4cc96925-da9f-455a-ab3b-8a0727e69fc1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.363620 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cc96925-da9f-455a-ab3b-8a0727e69fc1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5a53f59a-9cb7-4a54-b3e0-6fa2d9443e5e,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:52.371136 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-4cc96925-da9f-455a-ab3b-8a0727e69fc1 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=aa634cc6477c4e9487991d2dd18155aa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4240158 Nov 11 17:15:52.374432 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 58806) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:52.403609 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-237333d6-3e67-4b3c-9851-3f82437a1767 req-958d11ba-b3c2-46ca-a1b2-770d9430a106 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:52.405838 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-237333d6-3e67-4b3c-9851-3f82437a1767 req-958d11ba-b3c2-46ca-a1b2-770d9430a106 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.1607819 Nov 11 17:15:52.445395 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-88d769a4-5be8-4d99-a511-e16302f0db89 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.487434 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-88d769a4-5be8-4d99-a511-e16302f0db89 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.493230 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-237333d6-3e67-4b3c-9851-3f82437a1767 req-a36afba1-e7e6-4a44-87fb-271afab60f14 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782206 Nov 11 17:15:52.512605 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b9fa5731-e23d-4fda-aab3-1adcf8242fa7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.589381 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b9fa5731-e23d-4fda-aab3-1adcf8242fa7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.589605 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-88d769a4-5be8-4d99-a511-e16302f0db89 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.593237 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-88d769a4-5be8-4d99-a511-e16302f0db89 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.597145 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-88d769a4-5be8-4d99-a511-e16302f0db89 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/5a53f59a-9cb7-4a54-b3e0-6fa2d9443e5e HTTP/1.1" status: 204 len: 168 time: 0.2189536 Nov 11 17:15:52.623737 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88d769a4-5be8-4d99-a511-e16302f0db89 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a53f59a-9cb7-4a54-b3e0-6fa2d9443e5e,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:52.653560 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 58816) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:52.656294 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-b9fa5731-e23d-4fda-aab3-1adcf8242fa7 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=be1fbf4df3184f679aa7895402f6d706&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4173079 Nov 11 17:15:52.659233 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9fa5731-e23d-4fda-aab3-1adcf8242fa7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c916249-3e77-4efc-8888-681ee0c2040e,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:52.720042 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a4577131-6e30-457c-83e6-b6302400851a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.745122 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a4577131-6e30-457c-83e6-b6302400851a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.799320 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 58818) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:52.812810 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-6336ca51-e6fa-41f8-9cb3-1f7c3db64b8f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.844001 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a4577131-6e30-457c-83e6-b6302400851a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.846573 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a4577131-6e30-457c-83e6-b6302400851a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:52.847756 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-a4577131-6e30-457c-83e6-b6302400851a admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/2c916249-3e77-4efc-8888-681ee0c2040e HTTP/1.1" status: 204 len: 168 time: 0.1920557 Nov 11 17:15:52.866121 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4577131-6e30-457c-83e6-b6302400851a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c916249-3e77-4efc-8888-681ee0c2040e,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:52.921704 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-6336ca51-e6fa-41f8-9cb3-1f7c3db64b8f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:53.000426 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-6336ca51-e6fa-41f8-9cb3-1f7c3db64b8f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:53.044106 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-6336ca51-e6fa-41f8-9cb3-1f7c3db64b8f admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=7d72f956ace74ab6b468d43af934ca87&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2412803 Nov 11 17:15:53.046889 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58826) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:53.052113 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6336ca51-e6fa-41f8-9cb3-1f7c3db64b8f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=286b207f-ef65-41c0-8dbd-3e755e8bde49,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:53.098950 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9a08f209-c46e-4292-83b9-f015a0e1dd3e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:53.122468 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9a08f209-c46e-4292-83b9-f015a0e1dd3e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:53.142973 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:15:53.280730 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9a08f209-c46e-4292-83b9-f015a0e1dd3e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:53.284996 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9a08f209-c46e-4292-83b9-f015a0e1dd3e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:53.284996 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-9a08f209-c46e-4292-83b9-f015a0e1dd3e admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/286b207f-ef65-41c0-8dbd-3e755e8bde49 HTTP/1.1" status: 204 len: 168 time: 0.2367332 Nov 11 17:15:53.293049 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a08f209-c46e-4292-83b9-f015a0e1dd3e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=286b207f-ef65-41c0-8dbd-3e755e8bde49,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:53.643356 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-371d4faa-5743-4e41-ad20-46e26d787215 req-dcfb2467-608d-452a-b642-b86f2369e618 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:53.644812 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-371d4faa-5743-4e41-ad20-46e26d787215 req-dcfb2467-608d-452a-b642-b86f2369e618 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0512161 Nov 11 17:15:53.709029 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-371d4faa-5743-4e41-ad20-46e26d787215 req-64e373cb-a3a0-435b-9f2a-1e272b576fc0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501125 Nov 11 17:15:54.531463 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58928) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:54.835380 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4e4f2969-31f0-4537-9132-5359e7a6c184 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:54.870281 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-397389d4-407a-401d-9044-e6e006fae142 req-76b12a4b-b436-4967-9a75-7c7927f39c5e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:54.872358 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-397389d4-407a-401d-9044-e6e006fae142 req-76b12a4b-b436-4967-9a75-7c7927f39c5e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0823529 Nov 11 17:15:54.944841 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-397389d4-407a-401d-9044-e6e006fae142 req-6a4f5153-5c8a-4262-907d-d7e127f48fdb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637736 Nov 11 17:15:54.978867 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4e4f2969-31f0-4537-9132-5359e7a6c184 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:55.057465 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4e4f2969-31f0-4537-9132-5359e7a6c184 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:55.100238 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e4f2969-31f0-4537-9132-5359e7a6c184 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e2dba24-f7d4-4986-a75a-6d8d9a45ff74,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:55.104865 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-4e4f2969-31f0-4537-9132-5359e7a6c184 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=3bff428ab3b4496183f70fe549dc36f3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5716336 Nov 11 17:15:55.107573 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 58964) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:55.159240 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c8d3a51f-b6e2-4fc6-88de-2d93ff54e571 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:55.190087 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c8d3a51f-b6e2-4fc6-88de-2d93ff54e571 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:55.355550 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c8d3a51f-b6e2-4fc6-88de-2d93ff54e571 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:55.359232 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c8d3a51f-b6e2-4fc6-88de-2d93ff54e571 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:55.360126 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-c8d3a51f-b6e2-4fc6-88de-2d93ff54e571 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/0e2dba24-f7d4-4986-a75a-6d8d9a45ff74 HTTP/1.1" status: 204 len: 168 time: 0.2516270 Nov 11 17:15:55.370081 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8d3a51f-b6e2-4fc6-88de-2d93ff54e571 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e2dba24-f7d4-4986-a75a-6d8d9a45ff74,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:56.071319 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c5b3193-f525-491d-887e-6faa9e7f2d81 req-e63badb3-d04d-4af1-9943-c81b07d7f481 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:56.073086 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6c5b3193-f525-491d-887e-6faa9e7f2d81 req-e63badb3-d04d-4af1-9943-c81b07d7f481 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0540187 Nov 11 17:15:56.085569 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59000) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:56.107151 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fccc02f4-1745-45ce-a59a-d5f520ed55fd admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:56.148920 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6c5b3193-f525-491d-887e-6faa9e7f2d81 req-6dd906e6-c358-4de8-8d93-da4f4f63a50c tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0694945 Nov 11 17:15:56.198867 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fccc02f4-1745-45ce-a59a-d5f520ed55fd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:56.291511 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fccc02f4-1745-45ce-a59a-d5f520ed55fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:56.332793 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-fccc02f4-1745-45ce-a59a-d5f520ed55fd admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=9fdbd111608f404eba427ac74dff84d4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2453203 Nov 11 17:15:56.334943 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fccc02f4-1745-45ce-a59a-d5f520ed55fd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5288b2f1-89fa-4b07-aa9a-e59ee25b44a5,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:56.335975 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59012) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:56.398065 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-89a802b0-7c05-4476-81ba-7731dee8d917 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:56.421905 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-89a802b0-7c05-4476-81ba-7731dee8d917 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:56.720369 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-89a802b0-7c05-4476-81ba-7731dee8d917 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:56.723037 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-89a802b0-7c05-4476-81ba-7731dee8d917 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:56.732537 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-89a802b0-7c05-4476-81ba-7731dee8d917 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/5288b2f1-89fa-4b07-aa9a-e59ee25b44a5 HTTP/1.1" status: 204 len: 168 time: 0.3872252 Nov 11 17:15:56.732753 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89a802b0-7c05-4476-81ba-7731dee8d917 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5288b2f1-89fa-4b07-aa9a-e59ee25b44a5,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:57.265798 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df7bbe40-2996-4773-b571-97e8f3853481 req-927db24e-f472-4311-9b7b-8d4f7ef16fa2 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:57.267270 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-df7bbe40-2996-4773-b571-97e8f3853481 req-927db24e-f472-4311-9b7b-8d4f7ef16fa2 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0488629 Nov 11 17:15:57.316564 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-df7bbe40-2996-4773-b571-97e8f3853481 req-43b75257-2026-4285-acf6-87d080cf4e35 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430059 Nov 11 17:15:57.564301 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59042) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:57.577826 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-3b7d69cb-0b58-4ebf-9db1-4f99f7563061 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:57.654300 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-3b7d69cb-0b58-4ebf-9db1-4f99f7563061 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:57.788553 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-3b7d69cb-0b58-4ebf-9db1-4f99f7563061 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:57.828482 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b7d69cb-0b58-4ebf-9db1-4f99f7563061 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=774309ca-c50e-4f2c-b2f7-877330a06c78,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:57.832699 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-3b7d69cb-0b58-4ebf-9db1-4f99f7563061 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=c8d36915928d444999cdc421765ba5be&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2673702 Nov 11 17:15:57.835832 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59054) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:57.884943 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-818fd1c1-6d52-4b7a-ad6d-251252008593 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:57.910224 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-818fd1c1-6d52-4b7a-ad6d-251252008593 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:58.017418 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-818fd1c1-6d52-4b7a-ad6d-251252008593 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:58.020379 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-818fd1c1-6d52-4b7a-ad6d-251252008593 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:58.029937 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-818fd1c1-6d52-4b7a-ad6d-251252008593 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/774309ca-c50e-4f2c-b2f7-877330a06c78 HTTP/1.1" status: 204 len: 168 time: 0.1852083 Nov 11 17:15:58.035704 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-818fd1c1-6d52-4b7a-ad6d-251252008593 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=774309ca-c50e-4f2c-b2f7-877330a06c78,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:58.441584 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6212b861-8bc2-490f-8843-fdcc16158a44 req-54903751-5f34-4ccf-bd6b-2324151914df tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:58.441584 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6212b861-8bc2-490f-8843-fdcc16158a44 req-54903751-5f34-4ccf-bd6b-2324151914df tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0546110 Nov 11 17:15:58.505070 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6212b861-8bc2-490f-8843-fdcc16158a44 req-2ca93006-8256-4e5f-964b-5dd9744e3f38 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557430 Nov 11 17:15:59.338834 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59144) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:59.460147 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f5dec5d1-80f2-4b5c-aeb3-7fb92b164a0e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:59.767087 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3c0859-a26c-4802-90a0-9aa85877baf1 req-419155e9-dc65-4158-95c2-59c4a648ebf1 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:15:59.768504 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ab3c0859-a26c-4802-90a0-9aa85877baf1 req-419155e9-dc65-4158-95c2-59c4a648ebf1 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0780380 Nov 11 17:15:59.785501 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f5dec5d1-80f2-4b5c-aeb3-7fb92b164a0e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:59.822112 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ab3c0859-a26c-4802-90a0-9aa85877baf1 req-e38e63c8-0692-46de-abeb-21a7109254e9 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457168 Nov 11 17:15:59.863193 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f5dec5d1-80f2-4b5c-aeb3-7fb92b164a0e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:59.905614 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-f5dec5d1-80f2-4b5c-aeb3-7fb92b164a0e admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=cc04429abe7547a092e4a3147034fbc7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5656843 Nov 11 17:15:59.906618 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5dec5d1-80f2-4b5c-aeb3-7fb92b164a0e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=963ea198-b4b8-484d-b37a-e6f219e17363,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:15:59.909428 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59164) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:15:59.971436 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f94d9f36-aacd-4250-b9fa-3a7662ea2537 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:15:59.993594 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f94d9f36-aacd-4250-b9fa-3a7662ea2537 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:00.149048 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f94d9f36-aacd-4250-b9fa-3a7662ea2537 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:00.151732 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f94d9f36-aacd-4250-b9fa-3a7662ea2537 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:00.156480 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-f94d9f36-aacd-4250-b9fa-3a7662ea2537 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/963ea198-b4b8-484d-b37a-e6f219e17363 HTTP/1.1" status: 204 len: 168 time: 0.2425120 Nov 11 17:16:00.164260 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f94d9f36-aacd-4250-b9fa-3a7662ea2537 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=963ea198-b4b8-484d-b37a-e6f219e17363,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:00.943013 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59190) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:00.945884 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74d7f550-1599-4d7a-a64c-be6a04805ce0 req-021cd795-b242-46c3-9271-7b043cccf4c3 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:00.947944 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-74d7f550-1599-4d7a-a64c-be6a04805ce0 req-021cd795-b242-46c3-9271-7b043cccf4c3 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0542443 Nov 11 17:16:00.958942 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3a49e735-3516-4fc5-8b84-96e1d7dd60fd admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:00.983155 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-5862e420-1693-46ac-bb0b-09e15a62f510 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:01.007031 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-74d7f550-1599-4d7a-a64c-be6a04805ce0 req-af97a5bd-1141-4cd4-8a89-b43ee94f080f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508387 Nov 11 17:16:01.041441 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3a49e735-3516-4fc5-8b84-96e1d7dd60fd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:01.120910 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3a49e735-3516-4fc5-8b84-96e1d7dd60fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:01.164117 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-3a49e735-3516-4fc5-8b84-96e1d7dd60fd admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=ee984ee1cf584ea48589ccde4b70eba1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2193706 Nov 11 17:16:01.164437 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a49e735-3516-4fc5-8b84-96e1d7dd60fd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b60833bd-439d-431d-abe6-953f88470635,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:01.167072 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59196) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:01.227892 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f6603037-68ee-4bab-ba15-ef1c95769436 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:01.256304 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f6603037-68ee-4bab-ba15-ef1c95769436 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:01.452504 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f6603037-68ee-4bab-ba15-ef1c95769436 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:01.456880 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f6603037-68ee-4bab-ba15-ef1c95769436 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:01.458176 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-f6603037-68ee-4bab-ba15-ef1c95769436 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/b60833bd-439d-431d-abe6-953f88470635 HTTP/1.1" status: 204 len: 168 time: 0.2900329 Nov 11 17:16:01.469008 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6603037-68ee-4bab-ba15-ef1c95769436 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b60833bd-439d-431d-abe6-953f88470635,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:01.864718 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59226) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:02.002723 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bb0ddf5d-cec6-4527-a723-0407d426a022 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:02.155426 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bb0ddf5d-cec6-4527-a723-0407d426a022 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:02.173524 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559b8e32-8b70-4168-a21a-a908aad947ef req-ae28006e-89bd-45ac-9a4d-6e28aa0fdebd tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:02.182854 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-559b8e32-8b70-4168-a21a-a908aad947ef req-ae28006e-89bd-45ac-9a4d-6e28aa0fdebd tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0866864 Nov 11 17:16:02.236095 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bb0ddf5d-cec6-4527-a723-0407d426a022 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:02.239387 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-559b8e32-8b70-4168-a21a-a908aad947ef req-0a7d61b6-974d-45f5-9d6a-75ad72fe31d1 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0554667 Nov 11 17:16:02.292518 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59244) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:02.294457 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-bb0ddf5d-cec6-4527-a723-0407d426a022 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=b608061172d640d5ac7b5df94eb98243&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4285338 Nov 11 17:16:02.299526 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59246) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:02.316328 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb0ddf5d-cec6-4527-a723-0407d426a022 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=05b59eee-27f0-407c-9956-7e75f9277370,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:02.371610 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-29e7029a-5f83-439f-a784-0245d525390b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:02.398098 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-29e7029a-5f83-439f-a784-0245d525390b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:02.488236 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1a532e9f-565f-4cfa-a6b7-9c0c574df19b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:02.629861 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-29e7029a-5f83-439f-a784-0245d525390b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:02.632791 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-29e7029a-5f83-439f-a784-0245d525390b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:02.636397 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-29e7029a-5f83-439f-a784-0245d525390b admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/05b59eee-27f0-407c-9956-7e75f9277370 HTTP/1.1" status: 204 len: 168 time: 0.3332915 Nov 11 17:16:02.653383 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29e7029a-5f83-439f-a784-0245d525390b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=05b59eee-27f0-407c-9956-7e75f9277370,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:02.736672 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1a532e9f-565f-4cfa-a6b7-9c0c574df19b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:02.828100 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1a532e9f-565f-4cfa-a6b7-9c0c574df19b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:02.931841 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a532e9f-565f-4cfa-a6b7-9c0c574df19b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=42b9c00c-ea3a-459b-9cea-31de28a1e9a4,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:02.948516 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-1a532e9f-565f-4cfa-a6b7-9c0c574df19b admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=160f3377b4d74251a6bc4363faca7e89&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6548281 Nov 11 17:16:02.952124 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59278) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:03.009742 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bc6bf718-97ec-407e-874e-0f22414cd031 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:03.039570 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bc6bf718-97ec-407e-874e-0f22414cd031 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:03.171440 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bc6bf718-97ec-407e-874e-0f22414cd031 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:03.176781 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bc6bf718-97ec-407e-874e-0f22414cd031 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:03.187017 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-bc6bf718-97ec-407e-874e-0f22414cd031 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/42b9c00c-ea3a-459b-9cea-31de28a1e9a4 HTTP/1.1" status: 204 len: 168 time: 0.2264724 Nov 11 17:16:03.192090 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc6bf718-97ec-407e-874e-0f22414cd031 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42b9c00c-ea3a-459b-9cea-31de28a1e9a4,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:03.414963 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-037df144-6ddc-4ae1-8da2-8ab1376012d5 req-d0059a62-20f3-4f85-99bd-2bc6caf02f03 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:03.422878 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-037df144-6ddc-4ae1-8da2-8ab1376012d5 req-d0059a62-20f3-4f85-99bd-2bc6caf02f03 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0850518 Nov 11 17:16:03.480358 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-037df144-6ddc-4ae1-8da2-8ab1376012d5 req-4254aaaa-1c52-4802-9ed0-557e33d6341a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0565741 Nov 11 17:16:03.495064 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4c7253a8-3744-414c-b6e9-9b8ef2f94f52 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:03.895424 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59318) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:03.911668 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d4726649-4d61-4ee8-90a5-855a158a610a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:04.026171 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d4726649-4d61-4ee8-90a5-855a158a610a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:04.096364 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d4726649-4d61-4ee8-90a5-855a158a610a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:04.134923 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-d4726649-4d61-4ee8-90a5-855a158a610a admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=3872320b9aff4e35b14f27d0011d11ef&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2381005 Nov 11 17:16:04.137626 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4726649-4d61-4ee8-90a5-855a158a610a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ac037e8-d655-4a0e-ac4b-585c0cc5a8fb,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:04.144162 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59328) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:04.198733 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-952c8c5c-90e1-430b-a8af-020527283710 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:04.228865 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-952c8c5c-90e1-430b-a8af-020527283710 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:04.345672 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59344) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:04.422288 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-952c8c5c-90e1-430b-a8af-020527283710 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:04.425254 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-952c8c5c-90e1-430b-a8af-020527283710 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:04.426442 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-952c8c5c-90e1-430b-a8af-020527283710 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/8ac037e8-d655-4a0e-ac4b-585c0cc5a8fb HTTP/1.1" status: 204 len: 168 time: 0.2811089 Nov 11 17:16:04.436529 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-952c8c5c-90e1-430b-a8af-020527283710 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ac037e8-d655-4a0e-ac4b-585c0cc5a8fb,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:04.529662 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-514ca79d-6136-43bb-a73b-3ec5daefa1cf admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-965688447-network', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:04.633343 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:04.656289 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d88c09-e581-41a6-9818-6551c87fb9ce req-0da5d7b9-9932-4b29-8e0e-2e0c57b3f97d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:04.657771 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f5d88c09-e581-41a6-9818-6551c87fb9ce req-0da5d7b9-9932-4b29-8e0e-2e0c57b3f97d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0753691 Nov 11 17:16:04.690677 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-514ca79d-6136-43bb-a73b-3ec5daefa1cf admin admin] Made reservation on behalf of 10bedfb35d1e481aa78e025489c1be2d for: {'network': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:16:04.692984 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-514ca79d-6136-43bb-a73b-3ec5daefa1cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:04.702121 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-514ca79d-6136-43bb-a73b-3ec5daefa1cf admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:04.715176 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f5d88c09-e581-41a6-9818-6551c87fb9ce req-bfce7b49-0a29-477b-a33e-e3cd4c30c1e7 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459621 Nov 11 17:16:04.804431 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-514ca79d-6136-43bb-a73b-3ec5daefa1cf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:04.897625 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-514ca79d-6136-43bb-a73b-3ec5daefa1cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:04.922445 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-514ca79d-6136-43bb-a73b-3ec5daefa1cf admin admin] vlan segment allocate from pool success with {'vlan_id': 505, 'physical_network': 'physnet1'} {{(pid=102324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:16:04.937848 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-514ca79d-6136-43bb-a73b-3ec5daefa1cf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6431c11-5ada-4415-a616-91b316b8bb56,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:04.943707 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-514ca79d-6136-43bb-a73b-3ec5daefa1cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:04.944373 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.segments_db [None req-514ca79d-6136-43bb-a73b-3ec5daefa1cf admin admin] Added segment 8ac7fd42-d3df-4810-add0-6e5903972d61 of type vlan for network 45e6626a-2007-490b-a445-d7c3baea689e Nov 11 17:16:04.997379 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-514ca79d-6136-43bb-a73b-3ec5daefa1cf admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:05.142930 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-514ca79d-6136-43bb-a73b-3ec5daefa1cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:05.144349 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-514ca79d-6136-43bb-a73b-3ec5daefa1cf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:05.145694 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-514ca79d-6136-43bb-a73b-3ec5daefa1cf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:05.190903 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59382) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:05.213660 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-514ca79d-6136-43bb-a73b-3ec5daefa1cf admin admin] Pushing event updated for resources: {'Network': ['ID=45e6626a-2007-490b-a445-d7c3baea689e,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:05.224931 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network 45e6626a-2007-490b-a445-d7c3baea689e details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:16:05.268952 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-514ca79d-6136-43bb-a73b-3ec5daefa1cf admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.9220023 Nov 11 17:16:05.272511 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59388) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:05.281688 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-316a266d-6438-4b50-be25-ce9184bd566b admin admin] Request body: {'subnet': {'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-965688447-subnet', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'ip_version': 4}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:05.405555 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-316a266d-6438-4b50-be25-ce9184bd566b admin admin] Made reservation on behalf of 10bedfb35d1e481aa78e025489c1be2d for: {'subnet': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:16:05.409115 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-316a266d-6438-4b50-be25-ce9184bd566b admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5388291'] for subnet, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:05.536420 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-dc46b1db-d2ac-41ce-a8a3-2b95a4c55ae8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:05.763284 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-dc46b1db-d2ac-41ce-a8a3-2b95a4c55ae8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:05.829286 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-316a266d-6438-4b50-be25-ce9184bd566b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5720706', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5388333'] for subnet, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:05.866566 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-dc46b1db-d2ac-41ce-a8a3-2b95a4c55ae8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:05.952862 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4046e280-a65e-4197-9795-dae3a3597a34 req-ba201d59-16a1-4968-b070-31feccb5e838 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:05.968275 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4046e280-a65e-4197-9795-dae3a3597a34 req-ba201d59-16a1-4968-b070-31feccb5e838 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0904481 Nov 11 17:16:05.994419 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-dc46b1db-d2ac-41ce-a8a3-2b95a4c55ae8 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=715654fb99884e569362f92c5db2b61a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7987165 Nov 11 17:16:06.002477 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59426) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:06.012351 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-316a266d-6438-4b50-be25-ce9184bd566b admin admin] Pushing event updated for resources: {'Subnet': ['ID=bf78c82f-f2f3-4ef7-8052-be816dbd2df8,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:06.039550 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4046e280-a65e-4197-9795-dae3a3597a34 req-9a30e3e3-d162-46cf-a055-28cf9a7c7892 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0697875 Nov 11 17:16:06.063356 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc46b1db-d2ac-41ce-a8a3-2b95a4c55ae8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e86af1e4-a234-4753-a9c9-7939721d0074,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:06.095643 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-316a266d-6438-4b50-be25-ce9184bd566b admin admin] Checking segment: {'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:16:06.096830 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-316a266d-6438-4b50-be25-ce9184bd566b admin admin] Network hostable DHCP agents. Network: 45e6626a-2007-490b-a445-d7c3baea689e, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102323) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:16:06.187835 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-adfc97bc-401c-4eb3-8f48-665a23570a63 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:06.233840 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-adfc97bc-401c-4eb3-8f48-665a23570a63 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:06.254375 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-316a266d-6438-4b50-be25-ce9184bd566b admin admin] Network 45e6626a-2007-490b-a445-d7c3baea689e is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102323) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:16:06.366534 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:06.412339 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-adfc97bc-401c-4eb3-8f48-665a23570a63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:06.417826 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-adfc97bc-401c-4eb3-8f48-665a23570a63 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:06.417826 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-adfc97bc-401c-4eb3-8f48-665a23570a63 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/e86af1e4-a234-4753-a9c9-7939721d0074 HTTP/1.1" status: 204 len: 168 time: 0.4064934 Nov 11 17:16:06.419391 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-316a266d-6438-4b50-be25-ce9184bd566b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, 45e6626a-2007-490b-a445-d7c3baea689e) {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:16:06.439676 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-316a266d-6438-4b50-be25-ce9184bd566b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:06.440369 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-316a266d-6438-4b50-be25-ce9184bd566b admin admin] Publish callbacks [] for subnet, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:06.443292 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1e6c86a-fe26-4b20-a086-c0f1d2a00dde None None] Network 45e6626a-2007-490b-a445-d7c3baea689e requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:16:06.463747 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adfc97bc-401c-4eb3-8f48-665a23570a63 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e86af1e4-a234-4753-a9c9-7939721d0074,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:06.617489 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-316a266d-6438-4b50-be25-ce9184bd566b admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.3429072 Nov 11 17:16:06.620136 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59456) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:06.625730 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:06.708575 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaac6311d-333a-5f5f-a33c-91960009c34a-45e6626a-2007-490b-a445-d7c3baea689e', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8'}]}} from dv-cinder-694140-2-iscsi. {{(pid=102325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 17:16:06.709940 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:06.727197 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-424378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7339'] for router, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:06.729184 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-424390', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-397156', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7867629', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7328'] for router, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:06.801019 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:06.956504 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.db_base_plugin_common [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Allocated IP 172.20.0.2 (45e6626a-2007-490b-a445-d7c3baea689e/bf78c82f-f2f3-4ef7-8052-be816dbd2df8/fbbd6ac9-227d-4975-bedc-d7f706997b8d) {{(pid=102325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:16:07.077527 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:07.271093 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:07.330467 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Publish callbacks [] for port, precommit_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:07.416104 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3596013-6fa2-458b-a0e3-bbc0c6e9b6ce req-27a571ef-4ced-4a22-a492-c6efdcfe932a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:07.420834 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c3596013-6fa2-458b-a0e3-bbc0c6e9b6ce req-27a571ef-4ced-4a22-a492-c6efdcfe932a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.1456587 Nov 11 17:16:07.420966 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c39865bd-903c-4f8e-b4f3-dadfb97ee8b2 req-5d5849b4-79dc-4269-afff-8b17df7477e8 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:07.429234 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c39865bd-903c-4f8e-b4f3-dadfb97ee8b2 req-5d5849b4-79dc-4269-afff-8b17df7477e8 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.3289025 Nov 11 17:16:07.482022 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624'] for port, after_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:07.490232 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c3596013-6fa2-458b-a0e3-bbc0c6e9b6ce req-53dadb2e-773c-4d32-ae8f-5552244a421f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0614483 Nov 11 17:16:07.518030 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c39865bd-903c-4f8e-b4f3-dadfb97ee8b2 req-94c0643c-62e9-4042-a10e-0307773265bc tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0864642 Nov 11 17:16:07.529409 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Network 45e6626a-2007-490b-a445-d7c3baea689e is already hosted by enough agents. {{(pid=102325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:16:07.536225 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.base_scheduler [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Resources bound (agent type, host, resource id): {{(pid=102325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:16:07.544320 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Received port after_create {{(pid=102325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:16:07.587363 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Pushing event updated for resources: {'Port': ['ID=fbbd6ac9-227d-4975-bedc-d7f706997b8d,revision_number=1']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:07.614419 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:07.614813 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:07.615156 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:07.615489 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:07.615988 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:07.616211 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:07.616619 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:07.616974 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:07.617267 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:07.617602 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:07.617925 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:07.618241 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:07.634405 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Attempting to bind port fbbd6ac9-227d-4975-bedc-d7f706997b8d on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:16:07.634809 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Attempting to bind port fbbd6ac9-227d-4975-bedc-d7f706997b8d by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:16:07.635747 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Attempting to bind port fbbd6ac9-227d-4975-bedc-d7f706997b8d on network 45e6626a-2007-490b-a445-d7c3baea689e {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:16:07.644377 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 16, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:16:07.644823 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Checking segment: {'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:16:07.645200 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:07.645764 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Bound using segment: {'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:16:07.646392 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Bound port: fbbd6ac9-227d-4975-bedc-d7f706997b8d, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:16:07.646976 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:07.740427 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] For port fbbd6ac9-227d-4975-bedc-d7f706997b8d, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:16:07.748341 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] For port fbbd6ac9-227d-4975-bedc-d7f706997b8d, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=fbbd6ac9-227d-4975-bedc-d7f706997b8d,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:16:07.820277 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:07.834650 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:07.840287 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:07.928687 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dbb7d79-da20-4003-9dfb-4e23b71e0472 None None] Pushing event updated for resources: {'Port': ['ID=fbbd6ac9-227d-4975-bedc-d7f706997b8d,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:08.069253 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Allocated IP 172.27.1.190 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:16:08.275319 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:08.412270 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:08.425545 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199bf874-57a8-4f38-bdad-d1f193b8bb9b req-5634efc4-6c5a-4c0d-a6f4-bf9a1ab7a9d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:08.434321 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-199bf874-57a8-4f38-bdad-d1f193b8bb9b req-5634efc4-6c5a-4c0d-a6f4-bf9a1ab7a9d4 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 1098 time: 0.1444750 Nov 11 17:16:08.481063 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:16:08.489310 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:16:08.495409 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:16:08.532130 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-199bf874-57a8-4f38-bdad-d1f193b8bb9b req-6dc45574-2597-456e-87ed-9bb104cc1baf service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0865116 Nov 11 17:16:08.586093 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Pushing event updated for resources: {'Port': ['ID=8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:08.597711 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:08.598347 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:08.598852 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:08.599526 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:08.599994 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:08.600421 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:08.600821 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:08.601156 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:08.601480 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:08.602181 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:08.602181 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:08.602471 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:08.675259 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f86ce23b-3319-4a24-b569-991d9939bbcd req-26ac90b1-c4ef-4bcb-a882-9b41eea0aaba tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:08.677485 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f86ce23b-3319-4a24-b569-991d9939bbcd req-26ac90b1-c4ef-4bcb-a882-9b41eea0aaba tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0596759 Nov 11 17:16:08.764573 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f86ce23b-3319-4a24-b569-991d9939bbcd req-909f97c7-8bd5-4840-9442-4f26ce16a2c0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0778174 Nov 11 17:16:08.779616 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69164f22-6a61-4274-83b4-4f0a2a74cbca req-09836f59-5a40-44b4-bbd6-58557284b066 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:08.781411 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-69164f22-6a61-4274-83b4-4f0a2a74cbca req-09836f59-5a40-44b4-bbd6-58557284b066 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.1491652 Nov 11 17:16:08.864918 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-69164f22-6a61-4274-83b4-4f0a2a74cbca req-d72de89c-c1e0-41c6-bb22-106642886fb2 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0587931 Nov 11 17:16:09.097865 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:09.231939 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device fbbd6ac9-227d-4975-bedc-d7f706997b8d up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:16:09.331021 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e20b802-3c1a-4360-9592-91a1c904383e None None] Network 45e6626a-2007-490b-a445-d7c3baea689e requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:16:09.335091 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port fbbd6ac9-227d-4975-bedc-d7f706997b8d triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:09.335549 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:09.468902 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-850ff8b8-2b1e-4136-b635-f18bf55feda7 None None] Provisioning complete for port fbbd6ac9-227d-4975-bedc-d7f706997b8d triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:09.469211 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-850ff8b8-2b1e-4136-b635-f18bf55feda7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:09.597673 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:09.639249 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-424501', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-397235'] for router, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:09.732611 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] For port fbbd6ac9-227d-4975-bedc-d7f706997b8d, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=fbbd6ac9-227d-4975-bedc-d7f706997b8d,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:16:09.746090 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-850ff8b8-2b1e-4136-b635-f18bf55feda7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:09.840330 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:09.943750 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Router 1267b92b-e259-4df2-9704-b862470a9e03 is scheduled to L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 with binding_index 1 {{(pid=102324) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 17:16:09.982957 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a5afe86-1151-46d6-aa92-a2cc89add244 req-460156fc-b444-4eec-842e-ecf78d21c34e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:09.985386 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8a5afe86-1151-46d6-aa92-a2cc89add244 req-460156fc-b444-4eec-842e-ecf78d21c34e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0733812 Nov 11 17:16:10.053070 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.db.api [None req-850ff8b8-2b1e-4136-b635-f18bf55feda7 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102325) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 11 17:16:10.053359 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG oslo_db.api [None req-850ff8b8-2b1e-4136-b635-f18bf55feda7 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 11 17:16:10.060370 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Pushing event updated for resources: {'Port': ['ID=fbbd6ac9-227d-4975-bedc-d7f706997b8d,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:10.151395 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8a5afe86-1151-46d6-aa92-a2cc89add244 req-42a8d858-4201-49d8-ad56-4feb656abff8 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1543937 Nov 11 17:16:10.218642 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cad24fd4-ebe4-4de6-a951-34420f872267 req-7e631c2d-cfaa-4e1f-97d3-b4f62a018636 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:10.220013 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cad24fd4-ebe4-4de6-a951-34420f872267 req-7e631c2d-cfaa-4e1f-97d3-b4f62a018636 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.1255322 Nov 11 17:16:10.225734 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:16:10.238131 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Sync routers for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:16:10.248319 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:16:10.249042 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:16:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:16:10.279822 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cad24fd4-ebe4-4de6-a951-34420f872267 req-2477372a-d1fd-491b-8c77-136b1fc5eb74 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0482295 Nov 11 17:16:10.333737 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] Publish callbacks [] for router, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:10.335122 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-0e68fb0a-2cce-44c2-8f9f-3629783ddaed admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 3.7132292 Nov 11 17:16:10.337870 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59590) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:10.361235 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:16:10.586672 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:08Z', 'revision_number': 3, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:16:10.633466 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Checking router: 1267b92b-e259-4df2-9704-b862470a9e03 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:16:10.634268 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Updating router 1267b92b-e259-4df2-9704-b862470a9e03 port 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0 binding host dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:16:10.678881 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:10.731334 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fae305cb-be7e-411e-9494-d733f0fbc6f1 None None] Provisioning complete for port fbbd6ac9-227d-4975-bedc-d7f706997b8d triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:10.732438 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fae305cb-be7e-411e-9494-d733f0fbc6f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:10.854718 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:11.047843 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7e897040-1ede-458c-b00d-9d7a06d8b9b7 req-371df6a4-3ad2-41fb-87a3-4077a2a53b7b service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0645161 Nov 11 17:16:11.061258 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Allocated IP 172.20.0.1 (45e6626a-2007-490b-a445-d7c3baea689e/bf78c82f-f2f3-4ef7-8052-be816dbd2df8/170b88c1-ded4-4c5e-a307-63d78d797a5c) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:16:11.078859 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Publish callbacks [] for port, precommit_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:11.131217 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e897040-1ede-458c-b00d-9d7a06d8b9b7 req-f321c4b8-fb46-49da-9756-1decaaeb0ece service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:11.133510 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7e897040-1ede-458c-b00d-9d7a06d8b9b7 req-f321c4b8-fb46-49da-9756-1decaaeb0ece service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ed26d137d98846b9b45708f7e581e9b0&device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 1098 time: 0.0598254 Nov 11 17:16:11.183499 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device fbbd6ac9-227d-4975-bedc-d7f706997b8d up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:16:11.217070 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:11.220872 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:11.254849 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port fbbd6ac9-227d-4975-bedc-d7f706997b8d triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:11.255843 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:11.296488 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab7e59f8-65fb-4bc3-adeb-e371192a259c None None] Pushing event updated for resources: {'Port': ['ID=8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0,revision_number=2']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:11.311554 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab7e59f8-65fb-4bc3-adeb-e371192a259c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:11.311554 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab7e59f8-65fb-4bc3-adeb-e371192a259c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:11.311554 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab7e59f8-65fb-4bc3-adeb-e371192a259c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:11.311554 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab7e59f8-65fb-4bc3-adeb-e371192a259c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:11.311554 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab7e59f8-65fb-4bc3-adeb-e371192a259c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:11.311554 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab7e59f8-65fb-4bc3-adeb-e371192a259c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:11.312372 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab7e59f8-65fb-4bc3-adeb-e371192a259c None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:11.313028 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab7e59f8-65fb-4bc3-adeb-e371192a259c None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:11.313520 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab7e59f8-65fb-4bc3-adeb-e371192a259c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:11.314636 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab7e59f8-65fb-4bc3-adeb-e371192a259c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:11.315826 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab7e59f8-65fb-4bc3-adeb-e371192a259c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:11.316682 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab7e59f8-65fb-4bc3-adeb-e371192a259c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:11.422117 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Attempting to bind port 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:16:11.423462 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Attempting to bind port 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:16:11.424320 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Attempting to bind port 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0 on network 78b17769-6fae-453e-8ae3-4a72e72bccfc {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:16:11.439578 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 16, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:16:11.439578 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Checking segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:16:11.439578 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:11.439908 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:11.440015 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Bound using segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:16:11.440015 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Bound port: 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:16:11.440015 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:11.476435 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e897040-1ede-458c-b00d-9d7a06d8b9b7 req-93bd10ec-47be-4267-9d95-4d4930589065 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:11.479278 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7e897040-1ede-458c-b00d-9d7a06d8b9b7 req-93bd10ec-47be-4267-9d95-4d4930589065 service neutron] 10.222.0.10 "GET /v2.0/networks?id=983bda4c-112d-442d-b37a-387818bb1d45 HTTP/1.1" status: 200 len: 919 time: 0.3202429 Nov 11 17:16:11.494049 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4831cec4-af3b-47ce-8208-cd5cd7a4403e req-022ad796-0f7a-4c3d-9d28-320d33d8e3f9 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:11.499039 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] For port 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:16:11.502687 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] For port 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:16:11.507214 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4831cec4-af3b-47ce-8208-cd5cd7a4403e req-022ad796-0f7a-4c3d-9d28-320d33d8e3f9 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.2087102 Nov 11 17:16:11.518872 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Network 45e6626a-2007-490b-a445-d7c3baea689e is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:16:11.528145 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:16:11.531658 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:16:11.533611 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Pushing event updated for resources: {'Port': ['ID=170b88c1-ded4-4c5e-a307-63d78d797a5c,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:11.584108 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7e897040-1ede-458c-b00d-9d7a06d8b9b7 req-c35a946c-a99b-4a3f-84df-baef0126aed0 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=56aa9732-ebeb-41d7-ae07-03020a710285 HTTP/1.1" status: 200 len: 217 time: 0.0731387 Nov 11 17:16:11.584711 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675e2c62-fc83-4cd2-93f0-17f6fdd9fef7 req-f8d47ac7-edbf-4e64-8292-056bf83063ea tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:11.588602 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-675e2c62-fc83-4cd2-93f0-17f6fdd9fef7 req-f8d47ac7-edbf-4e64-8292-056bf83063ea tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.1126904 Nov 11 17:16:11.590430 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-394084'] for router_interface, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:11.668577 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:11.676453 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4831cec4-af3b-47ce-8208-cd5cd7a4403e req-8856235d-6c4a-403a-b261-8c43cd2ff0fc tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1678829 Nov 11 17:16:11.692434 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e897040-1ede-458c-b00d-9d7a06d8b9b7 req-403502e6-e360-4563-a949-13cf3ad4a001 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:11.694037 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7e897040-1ede-458c-b00d-9d7a06d8b9b7 req-403502e6-e360-4563-a949-13cf3ad4a001 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4 HTTP/1.1" status: 200 len: 858 time: 0.1023791 Nov 11 17:16:11.748256 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-675e2c62-fc83-4cd2-93f0-17f6fdd9fef7 req-ab1076ef-1eb8-4473-a5fa-16cdd6f3324e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1522160 Nov 11 17:16:11.779719 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7e897040-1ede-458c-b00d-9d7a06d8b9b7 req-488c47d9-b250-4295-a56f-257d1df29627 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=983bda4c-112d-442d-b37a-387818bb1d45&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0710299 Nov 11 17:16:11.791281 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:16:11.791992 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:16:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:16:11.880544 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab7e59f8-65fb-4bc3-adeb-e371192a259c None None] Pushing event updated for resources: {'Port': ['ID=8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0,revision_number=3']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:11.900847 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-e7515fe0-2468-4534-8c1e-b3ade86208ae None None] Provisioning complete for port 170b88c1-ded4-4c5e-a307-63d78d797a5c triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:11.901530 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-e7515fe0-2468-4534-8c1e-b3ade86208ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:11.938486 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7e897040-1ede-458c-b00d-9d7a06d8b9b7 req-2b1bba67-c94b-4945-9a1f-9c7f63e7c4fd service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1492550 Nov 11 17:16:11.961150 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-e7515fe0-2468-4534-8c1e-b3ade86208ae None None] Port 170b88c1-ded4-4c5e-a307-63d78d797a5c cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:16:11.988524 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:16:12.019798 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:12.081750 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7e897040-1ede-458c-b00d-9d7a06d8b9b7 req-56af5224-e3f9-43df-bdac-7ce0199b2b98 service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1350355 Nov 11 17:16:12.299319 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:08Z', 'revision_number': 3, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:16:12.328238 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:12.344317 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d8dc1b4-3464-4ebb-8da6-d03a52d7dff8 None None] The sync data for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi is: [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:08Z', 'revision_number': 3, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:16:12.362272 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d76abf8b-1ceb-4759-8c40-459f56721d15 req-d4e64de4-bb27-4971-a376-9a6adcc084aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:12.364800 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d76abf8b-1ceb-4759-8c40-459f56721d15 req-d4e64de4-bb27-4971-a376-9a6adcc084aa service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ed26d137d98846b9b45708f7e581e9b0&device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 1098 time: 0.0826011 Nov 11 17:16:12.365233 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb16d11e-f6d2-46e2-8879-11b50252b909 req-94668989-4fe4-4196-a349-e57b2279aec2 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:12.366895 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cb16d11e-f6d2-46e2-8879-11b50252b909 req-94668989-4fe4-4196-a349-e57b2279aec2 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0762017 Nov 11 17:16:12.438313 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:12.477631 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d76abf8b-1ceb-4759-8c40-459f56721d15 req-49c37a9e-c0f6-4480-9cd7-cf1cfa8a3fb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:12.479606 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d76abf8b-1ceb-4759-8c40-459f56721d15 req-49c37a9e-c0f6-4480-9cd7-cf1cfa8a3fb9 service neutron] 10.222.0.10 "GET /v2.0/networks?id=983bda4c-112d-442d-b37a-387818bb1d45 HTTP/1.1" status: 200 len: 919 time: 0.1037476 Nov 11 17:16:12.526972 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8103788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-394224'] for router_interface, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:12.532987 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d76abf8b-1ceb-4759-8c40-459f56721d15 req-77d67e60-71eb-4612-86d3-5bf0c180c94a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=904b538c-2fcd-42a3-bc02-26c84d4d00cb HTTP/1.1" status: 200 len: 217 time: 0.0412426 Nov 11 17:16:12.534654 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cb16d11e-f6d2-46e2-8879-11b50252b909 req-531c170a-e1da-404f-8c75-4e778530e0d5 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1588595 Nov 11 17:16:12.603006 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d76abf8b-1ceb-4759-8c40-459f56721d15 req-02efdcf7-8597-427f-a5d8-3ca059cf14e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:12.608638 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d76abf8b-1ceb-4759-8c40-459f56721d15 req-02efdcf7-8597-427f-a5d8-3ca059cf14e1 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4 HTTP/1.1" status: 200 len: 858 time: 0.0666900 Nov 11 17:16:12.659766 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d76abf8b-1ceb-4759-8c40-459f56721d15 req-75aef54b-1a58-4f57-b8b0-a3bb85457193 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=983bda4c-112d-442d-b37a-387818bb1d45&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0314066 Nov 11 17:16:12.669142 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Network 45e6626a-2007-490b-a445-d7c3baea689e is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:16:12.673668 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:16:12.681123 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Pushing event updated for resources: {'Port': ['ID=170b88c1-ded4-4c5e-a307-63d78d797a5c,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:12.877375 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d76abf8b-1ceb-4759-8c40-459f56721d15 req-ef51be11-7c12-456a-a1fe-a65869f61aca service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2095203 Nov 11 17:16:12.897195 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Router 1267b92b-e259-4df2-9704-b862470a9e03 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:16:13.052382 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a7699ca-cb12-485a-91e3-1d834faa4297 req-001fef06-bf5c-4ce6-9d3b-f59978b163e2 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:13.061513 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1a7699ca-cb12-485a-91e3-1d834faa4297 req-001fef06-bf5c-4ce6-9d3b-f59978b163e2 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.1343064 Nov 11 17:16:13.063926 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:16:13.102036 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-cd33525e-e6aa-4bc9-8048-486fb771b347 admin admin] 10.222.0.16 "PUT /v2.0/routers/1267b92b-e259-4df2-9704-b862470a9e03/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7630277 Nov 11 17:16:13.124567 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-c5e7109a-a943-4730-8a63-d38d8af3a614 None None] Provisioning complete for port 170b88c1-ded4-4c5e-a307-63d78d797a5c triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:13.125492 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c5e7109a-a943-4730-8a63-d38d8af3a614 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:13.128912 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d76abf8b-1ceb-4759-8c40-459f56721d15 req-49db1ecf-74e1-439b-a0c4-1064331d1eb9 service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2268026 Nov 11 17:16:13.238764 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1a7699ca-cb12-485a-91e3-1d834faa4297 req-70ec2a26-bdb1-4bd0-86c9-08712d94655c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1748059 Nov 11 17:16:13.242314 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-c5e7109a-a943-4730-8a63-d38d8af3a614 None None] Port 170b88c1-ded4-4c5e-a307-63d78d797a5c cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:16:13.316216 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:16:13.374102 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:13.374652 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:13.479264 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:13.502045 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] For port 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:16:13.622899 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:13.723301 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Pushing event updated for resources: {'Port': ['ID=8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:13.771674 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66773d7e-3ffc-4000-805c-be3fc622f01a req-af5c2c78-a0a7-4a79-9ff8-bf727578c353 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:13.773206 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-66773d7e-3ffc-4000-805c-be3fc622f01a req-af5c2c78-a0a7-4a79-9ff8-bf727578c353 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.1087368 Nov 11 17:16:13.829548 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59740) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:13.841275 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-66773d7e-3ffc-4000-805c-be3fc622f01a req-ac810f81-338f-4726-9816-005451338f58 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602639 Nov 11 17:16:14.013232 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f811f920-d15b-48e9-b3c3-36dbd5f6df42 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:14.116098 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f811f920-d15b-48e9-b3c3-36dbd5f6df42 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:14.194832 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59762) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:14.200811 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-354798896-network', 'tenant_id': 'ab572ed9fb234e2eb59dd278b16bf840'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:14.314216 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f811f920-d15b-48e9-b3c3-36dbd5f6df42 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:14.351480 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f811f920-d15b-48e9-b3c3-36dbd5f6df42 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bbc623a2-239e-4194-b100-3b5e9d11442e,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:14.368644 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-f811f920-d15b-48e9-b3c3-36dbd5f6df42 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=77909e3d75c949528d10f49c5cadb4ee&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5286050 Nov 11 17:16:14.370226 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59768) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:14.376860 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bda6392-4454-4451-9aaf-48ac15eed96e req-236bcc5a-7eb6-4366-b884-3832e214b80a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:14.378729 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8bda6392-4454-4451-9aaf-48ac15eed96e req-236bcc5a-7eb6-4366-b884-3832e214b80a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.0622337 Nov 11 17:16:14.380032 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Made reservation on behalf of ab572ed9fb234e2eb59dd278b16bf840 for: {'network': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:16:14.383769 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:14.416630 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:14.458368 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f6301c77-f749-440f-9cf9-10c087786bf6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:14.477719 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8bda6392-4454-4451-9aaf-48ac15eed96e req-6aa4a87a-3b27-4bb2-bd25-f17963cff963 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0813558 Nov 11 17:16:14.494917 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f6301c77-f749-440f-9cf9-10c087786bf6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:14.536055 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Sync routers for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:16:14.572456 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:16:14.573090 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:16:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:16:14.600635 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:14.633907 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f6301c77-f749-440f-9cf9-10c087786bf6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:14.638004 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f6301c77-f749-440f-9cf9-10c087786bf6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:14.638004 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-f6301c77-f749-440f-9cf9-10c087786bf6 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/bbc623a2-239e-4194-b100-3b5e9d11442e HTTP/1.1" status: 204 len: 168 time: 0.2612467 Nov 11 17:16:14.647488 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6301c77-f749-440f-9cf9-10c087786bf6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bbc623a2-239e-4194-b100-3b5e9d11442e,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:14.691671 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:14.715294 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] vlan segment allocate from pool success with {'vlan_id': 507, 'physical_network': 'physnet1'} {{(pid=102323) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:16:14.741854 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:14.744644 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.segments_db [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Added segment 5cee43f7-3e92-4b3d-a674-c03de2d33f3f of type vlan for network d863ef72-568a-44c9-9174-02dbf417bf28 Nov 11 17:16:14.831114 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c53aca1-c8db-4cf7-bab4-7e6fee412470,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:14.836310 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:14.847340 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:14.847870 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:14.848203 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:14.848763 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:14.849285 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:14.849689 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:14.850082 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:14.850475 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:14.850895 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:14.851279 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:14.851830 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:14.852214 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:16:14.856349 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:16:14.942399 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:14.943610 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:14.944605 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:15.004748 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f19f64db-adb2-412c-98bb-424d12b73eec req-68535de7-e9dc-4e7f-b74f-5f4c3e66eb3b tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:15.006970 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f19f64db-adb2-412c-98bb-424d12b73eec req-68535de7-e9dc-4e7f-b74f-5f4c3e66eb3b tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0728581 Nov 11 17:16:15.030163 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] Pushing event updated for resources: {'Network': ['ID=d863ef72-568a-44c9-9174-02dbf417bf28,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:15.043582 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network d863ef72-568a-44c9-9174-02dbf417bf28 details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:16:15.072173 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-e516bb42-05df-4533-ad28-0cbdafbc1035 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.8761652 Nov 11 17:16:15.075884 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59792) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:15.083363 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-abfc824c-8274-437e-8bfe-28bd66a2301e admin admin] Request body: {'subnet': {'network_id': 'd863ef72-568a-44c9-9174-02dbf417bf28', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-354798896-subnet', 'tenant_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'ip_version': 4}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:15.201233 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-abfc824c-8274-437e-8bfe-28bd66a2301e admin admin] Made reservation on behalf of ab572ed9fb234e2eb59dd278b16bf840 for: {'subnet': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:16:15.204997 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-abfc824c-8274-437e-8bfe-28bd66a2301e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5388291'] for subnet, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:15.226965 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:16:15.291485 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:12Z', 'revision_number': 2, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:16:15.331193 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Checking router: 1267b92b-e259-4df2-9704-b862470a9e03 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:16:15.331554 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Updating router 1267b92b-e259-4df2-9704-b862470a9e03 port 170b88c1-ded4-4c5e-a307-63d78d797a5c binding host dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:16:15.352643 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f19f64db-adb2-412c-98bb-424d12b73eec req-dc682a52-038a-4230-838e-d595725b6fcd tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3380513 Nov 11 17:16:15.362441 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59798) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:15.371734 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:15.382221 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:15.382625 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:15.546365 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5732fc65-3717-4a75-93c1-5b576e8c0f62 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:15.626112 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b3b688f-c754-4e5d-a756-025e1808b927 req-301dd2e2-82df-41ee-a8ad-e7ae11ddfb66 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:15.627877 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1b3b688f-c754-4e5d-a756-025e1808b927 req-301dd2e2-82df-41ee-a8ad-e7ae11ddfb66 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.0583758 Nov 11 17:16:15.656313 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5732fc65-3717-4a75-93c1-5b576e8c0f62 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:15.689269 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1b3b688f-c754-4e5d-a756-025e1808b927 req-380488c7-2cfc-49c8-b4d1-5bed68a1cbbd tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0504899 Nov 11 17:16:15.691118 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-abfc824c-8274-437e-8bfe-28bd66a2301e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5720706', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5388333'] for subnet, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:15.729271 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5732fc65-3717-4a75-93c1-5b576e8c0f62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:15.758238 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abfc824c-8274-437e-8bfe-28bd66a2301e admin admin] Pushing event updated for resources: {'Subnet': ['ID=3ff29672-2a30-4e62-8d64-1fc0068451f0,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:15.762921 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Publish callbacks [] for port, precommit_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:15.777680 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-5732fc65-3717-4a75-93c1-5b576e8c0f62 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=d8ec8bfd803c414caab8708ca2c099c8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4138749 Nov 11 17:16:15.783801 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59816) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:15.785526 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-abfc824c-8274-437e-8bfe-28bd66a2301e admin admin] Checking segment: {'id': '5cee43f7-3e92-4b3d-a674-c03de2d33f3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'd863ef72-568a-44c9-9174-02dbf417bf28'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:16:15.785890 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-abfc824c-8274-437e-8bfe-28bd66a2301e admin admin] Network hostable DHCP agents. Network: d863ef72-568a-44c9-9174-02dbf417bf28, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102323) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:16:15.821486 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5732fc65-3717-4a75-93c1-5b576e8c0f62 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=437fcef0-f5e9-4dd8-a36d-6e1e5bfc0735,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:15.830878 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:15.859745 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-aec49f2d-20a2-443e-b6c0-60b9c1161a56 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:15.885294 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-abfc824c-8274-437e-8bfe-28bd66a2301e admin admin] Network d863ef72-568a-44c9-9174-02dbf417bf28 is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102323) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:16:15.899188 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad92ed9f-faa9-4ac0-b4e0-7586d4d3cbac None None] Pushing event updated for resources: {'Port': ['ID=170b88c1-ded4-4c5e-a307-63d78d797a5c,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:15.913361 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-aec49f2d-20a2-443e-b6c0-60b9c1161a56 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:15.954305 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59822) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:15.988229 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-abfc824c-8274-437e-8bfe-28bd66a2301e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, d863ef72-568a-44c9-9174-02dbf417bf28) {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:16:15.990401 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Attempting to bind port 170b88c1-ded4-4c5e-a307-63d78d797a5c on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:16:15.993908 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-abfc824c-8274-437e-8bfe-28bd66a2301e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:15.994213 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-abfc824c-8274-437e-8bfe-28bd66a2301e admin admin] Publish callbacks [] for subnet, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:15.997280 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Attempting to bind port 170b88c1-ded4-4c5e-a307-63d78d797a5c by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:16:15.997794 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Attempting to bind port 170b88c1-ded4-4c5e-a307-63d78d797a5c on network 45e6626a-2007-490b-a445-d7c3baea689e {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:16:16.007172 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba9ea1a8-9d26-43f8-9a0e-9ce0cbb285fd None None] Network d863ef72-568a-44c9-9174-02dbf417bf28 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:16:16.074597 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 16, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:16:16.078086 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Checking segment: {'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:16:16.078263 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:16.078718 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Bound using segment: {'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:16:16.079245 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Bound port: 170b88c1-ded4-4c5e-a307-63d78d797a5c, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:16:16.079639 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:16.098825 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-aec49f2d-20a2-443e-b6c0-60b9c1161a56 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:16.102667 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-aec49f2d-20a2-443e-b6c0-60b9c1161a56 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:16.106490 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-aec49f2d-20a2-443e-b6c0-60b9c1161a56 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/437fcef0-f5e9-4dd8-a36d-6e1e5bfc0735 HTTP/1.1" status: 204 len: 168 time: 0.3193665 Nov 11 17:16:16.135332 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aec49f2d-20a2-443e-b6c0-60b9c1161a56 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=437fcef0-f5e9-4dd8-a36d-6e1e5bfc0735,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:16.135873 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-12563939-180f-44a6-88af-d3b4fe5a420a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:16.141881 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-abfc824c-8274-437e-8bfe-28bd66a2301e admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.0624208 Nov 11 17:16:16.144420 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59834) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:16.149348 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-354798896-router', 'tenant_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:16.246427 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-c19e6843-ac82-4221-b991-6462cf81958e None None] Provisioning complete for port 170b88c1-ded4-4c5e-a307-63d78d797a5c triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:16.246831 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c19e6843-ac82-4221-b991-6462cf81958e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:16.251069 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] For port 170b88c1-ded4-4c5e-a307-63d78d797a5c, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:16:16.267960 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-424378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7339'] for router, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:16.269658 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-424390', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-397156', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7867629', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7328'] for router, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:16.277553 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-12563939-180f-44a6-88af-d3b4fe5a420a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:16.331381 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] For port 170b88c1-ded4-4c5e-a307-63d78d797a5c, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=170b88c1-ded4-4c5e-a307-63d78d797a5c,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:16:16.338442 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-c19e6843-ac82-4221-b991-6462cf81958e None None] Port 170b88c1-ded4-4c5e-a307-63d78d797a5c cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:16:16.346368 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:16.349140 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-12563939-180f-44a6-88af-d3b4fe5a420a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:16.398461 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaac6311d-333a-5f5f-a33c-91960009c34a-d863ef72-568a-44c9-9174-02dbf417bf28', 'network_id': 'd863ef72-568a-44c9-9174-02dbf417bf28', 'tenant_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'fixed_ips': [{'subnet_id': '3ff29672-2a30-4e62-8d64-1fc0068451f0'}]}} from dv-cinder-694140-2-iscsi. {{(pid=102325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 17:16:16.399538 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:16.423371 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:16.427221 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-12563939-180f-44a6-88af-d3b4fe5a420a admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=aa13744396cb4626a4974a73d0afcd2e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4714379 Nov 11 17:16:16.429455 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12563939-180f-44a6-88af-d3b4fe5a420a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=052da5be-c6e1-46a0-b98c-092cfd518dc5,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:16.429838 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59850) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:16.726191 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3a88f79b-3e91-4493-831a-3328ee6336fc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:16.783755 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:16:16.787732 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:16:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:16:16.797933 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db191586-ad52-423d-8525-78e15d0a2718 req-2350880a-aeee-4079-835c-af1890be7b17 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:16.804317 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59864) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:16.812686 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad92ed9f-faa9-4ac0-b4e0-7586d4d3cbac None None] Pushing event updated for resources: {'Port': ['ID=170b88c1-ded4-4c5e-a307-63d78d797a5c,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:16.824674 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-db191586-ad52-423d-8525-78e15d0a2718 req-2350880a-aeee-4079-835c-af1890be7b17 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.2877636 Nov 11 17:16:16.855300 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:16.895251 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3a88f79b-3e91-4493-831a-3328ee6336fc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.000775 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.032123 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76f09af0-fc84-489e-9489-edda16fd88b5 req-315c49b3-7c30-4ad9-bb74-e912e6ed3bcb tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:17.041046 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-76f09af0-fc84-489e-9489-edda16fd88b5 req-315c49b3-7c30-4ad9-bb74-e912e6ed3bcb tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.1659651 Nov 11 17:16:17.044698 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-db191586-ad52-423d-8525-78e15d0a2718 req-338fbc7e-ee13-4af8-9de7-a07af7417d68 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2001734 Nov 11 17:16:17.047070 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.db_base_plugin_common [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Allocated IP 172.20.0.2 (d863ef72-568a-44c9-9174-02dbf417bf28/3ff29672-2a30-4e62-8d64-1fc0068451f0/819a44ba-1b06-406f-bec0-46cb9e3bc564) {{(pid=102325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:16:17.062688 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-b34417e7-6b64-4774-a228-bcb3ac20bc5e None None] Provisioning complete for port 170b88c1-ded4-4c5e-a307-63d78d797a5c triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:17.063068 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b34417e7-6b64-4774-a228-bcb3ac20bc5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.091920 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3a88f79b-3e91-4493-831a-3328ee6336fc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.096482 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3a88f79b-3e91-4493-831a-3328ee6336fc admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.099324 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-3a88f79b-3e91-4493-831a-3328ee6336fc admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/052da5be-c6e1-46a0-b98c-092cfd518dc5 HTTP/1.1" status: 204 len: 168 time: 0.6658816 Nov 11 17:16:17.138699 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a88f79b-3e91-4493-831a-3328ee6336fc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=052da5be-c6e1-46a0-b98c-092cfd518dc5,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:17.146060 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:16:17.153189 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-9e6267e5-74e9-4486-b637-2579eeb6b402 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1575499940-network', 'tenant_id': '1b90b3d6739f4eef8dc3f2a78bb8a043'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:17.169479 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59874) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:17.184230 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-02a3acea-91e2-43f1-9ff9-4371be3c37f1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.223346 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-76f09af0-fc84-489e-9489-edda16fd88b5 req-fe340db4-8110-41c1-ab0f-1cf00e740d96 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1627448 Nov 11 17:16:17.295815 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9e6267e5-74e9-4486-b637-2579eeb6b402 admin admin] Made reservation on behalf of 1b90b3d6739f4eef8dc3f2a78bb8a043 for: {'network': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:16:17.299161 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9e6267e5-74e9-4486-b637-2579eeb6b402 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.312320 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9e6267e5-74e9-4486-b637-2579eeb6b402 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.334765 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-02a3acea-91e2-43f1-9ff9-4371be3c37f1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.475479 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-02a3acea-91e2-43f1-9ff9-4371be3c37f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.543319 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-02a3acea-91e2-43f1-9ff9-4371be3c37f1 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=8136af3ba28e4b46b2b135f3027bc0ca&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3726909 Nov 11 17:16:17.549379 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59878) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:17.588309 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02a3acea-91e2-43f1-9ff9-4371be3c37f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ba1f07ab-6b1e-4c8c-97ab-37a5645a4632,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:17.619331 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b34417e7-6b64-4774-a228-bcb3ac20bc5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.650476 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-77a9021b-dc7f-4e53-8752-7eb4fe0bc035 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.669689 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9e6267e5-74e9-4486-b637-2579eeb6b402 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.695978 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-77a9021b-dc7f-4e53-8752-7eb4fe0bc035 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.712663 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Publish callbacks [] for port, precommit_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.724489 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-b34417e7-6b64-4774-a228-bcb3ac20bc5e None None] For port 170b88c1-ded4-4c5e-a307-63d78d797a5c, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=170b88c1-ded4-4c5e-a307-63d78d797a5c,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:16:17.751912 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9e6267e5-74e9-4486-b637-2579eeb6b402 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.754843 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:16Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:16:17.779796 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.786513 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffb9a848-5ec2-411d-a41c-30fb56c1f0d7 None None] The sync data for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi is: [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:16Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:16:17.815359 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.825092 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b34417e7-6b64-4774-a228-bcb3ac20bc5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.826250 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e6267e5-74e9-4486-b637-2579eeb6b402 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=991c1715-5109-4fc3-8225-d53b129684ea,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:17.856634 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-77a9021b-dc7f-4e53-8752-7eb4fe0bc035 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.868536 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624'] for port, after_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.872356 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-77a9021b-dc7f-4e53-8752-7eb4fe0bc035 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:17.873536 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-77a9021b-dc7f-4e53-8752-7eb4fe0bc035 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/ba1f07ab-6b1e-4c8c-97ab-37a5645a4632 HTTP/1.1" status: 204 len: 168 time: 0.3228674 Nov 11 17:16:17.911647 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77a9021b-dc7f-4e53-8752-7eb4fe0bc035 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba1f07ab-6b1e-4c8c-97ab-37a5645a4632,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:17.925035 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Network d863ef72-568a-44c9-9174-02dbf417bf28 is already hosted by enough agents. {{(pid=102325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:16:17.940181 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.base_scheduler [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Resources bound (agent type, host, resource id): {{(pid=102325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:16:17.955604 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Received port after_create {{(pid=102325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:16:18.051265 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b34417e7-6b64-4774-a228-bcb3ac20bc5e None None] Pushing event updated for resources: {'Port': ['ID=170b88c1-ded4-4c5e-a307-63d78d797a5c,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:18.083904 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Allocated IP 172.27.1.66 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/6699bf5b-f6f9-4665-b1ea-b301a8acd3b4) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:16:18.147347 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Attempting to bind port 819a44ba-1b06-406f-bec0-46cb9e3bc564 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:16:18.147825 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Attempting to bind port 819a44ba-1b06-406f-bec0-46cb9e3bc564 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '5cee43f7-3e92-4b3d-a674-c03de2d33f3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'd863ef72-568a-44c9-9174-02dbf417bf28'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:16:18.148157 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Attempting to bind port 819a44ba-1b06-406f-bec0-46cb9e3bc564 on network d863ef72-568a-44c9-9174-02dbf417bf28 {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:16:18.162061 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 16, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:16:18.162947 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Checking segment: {'id': '5cee43f7-3e92-4b3d-a674-c03de2d33f3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'd863ef72-568a-44c9-9174-02dbf417bf28'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:16:18.163195 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:18.163623 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Bound using segment: {'id': '5cee43f7-3e92-4b3d-a674-c03de2d33f3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'd863ef72-568a-44c9-9174-02dbf417bf28'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:16:18.164225 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Bound port: 819a44ba-1b06-406f-bec0-46cb9e3bc564, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5cee43f7-3e92-4b3d-a674-c03de2d33f3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'd863ef72-568a-44c9-9174-02dbf417bf28'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:16:18.164735 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:18.207331 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9e6267e5-74e9-4486-b637-2579eeb6b402 admin admin] vlan segment allocate from pool success with {'vlan_id': 508, 'physical_network': 'physnet1'} {{(pid=102323) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:16:18.244186 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9e6267e5-74e9-4486-b637-2579eeb6b402 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:18.244601 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.segments_db [None req-9e6267e5-74e9-4486-b637-2579eeb6b402 admin admin] Added segment 92668025-4f51-4378-b7fa-fd59b584fd19 of type vlan for network 3f528faa-b7d7-4ae6-81a7-c001fae97f70 Nov 11 17:16:18.250127 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Pushing event updated for resources: {'Port': ['ID=819a44ba-1b06-406f-bec0-46cb9e3bc564,revision_number=1']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:18.331870 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:18.421751 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9e6267e5-74e9-4486-b637-2579eeb6b402 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:18.422933 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] For port 819a44ba-1b06-406f-bec0-46cb9e3bc564, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:16:18.441530 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:18.443923 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] For port 819a44ba-1b06-406f-bec0-46cb9e3bc564, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=819a44ba-1b06-406f-bec0-46cb9e3bc564,segment=NetworkSegment(5cee43f7-3e92-4b3d-a674-c03de2d33f3f),segment_id=5cee43f7-3e92-4b3d-a674-c03de2d33f3f)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:16:18.451909 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e0ff669-5ec1-437b-b88f-493f761f47d0 req-184701f0-eaf8-4ceb-a385-4596d1ca210a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:18.454482 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6e0ff669-5ec1-437b-b88f-493f761f47d0 req-184701f0-eaf8-4ceb-a385-4596d1ca210a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.0818865 Nov 11 17:16:18.514781 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:16:18.526750 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:16:18.526750 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:16:18.531209 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6e0ff669-5ec1-437b-b88f-493f761f47d0 req-dad9c576-3829-4ddc-9a91-b8942c1638df tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0692885 Nov 11 17:16:18.550108 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:18.571717 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Pushing event updated for resources: {'Port': ['ID=6699bf5b-f6f9-4665-b1ea-b301a8acd3b4,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:18.614711 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9e6267e5-74e9-4486-b637-2579eeb6b402 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:18.616120 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e6267e5-74e9-4486-b637-2579eeb6b402 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:18.616941 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9e6267e5-74e9-4486-b637-2579eeb6b402 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:18.626651 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d885dea-713c-48ae-a8e4-51a3f9302ad3 None None] Pushing event updated for resources: {'Port': ['ID=819a44ba-1b06-406f-bec0-46cb9e3bc564,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:18.634379 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 5de5065e-0ad8-4180-bd18-4e9927716a88 details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:16:18.760692 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-9e6267e5-74e9-4486-b637-2579eeb6b402 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.9552219 Nov 11 17:16:18.765338 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59920) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:18.771267 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-12a848ee-4b65-441a-ba23-cd81e7c6f4f2 admin admin] Request body: {'subnet': {'network_id': '3f528faa-b7d7-4ae6-81a7-c001fae97f70', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1575499940-subnet', 'tenant_id': '1b90b3d6739f4eef8dc3f2a78bb8a043', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:18.800045 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 5de5065e-0ad8-4180-bd18-4e9927716a88, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5de5065e-0ad8-4180-bd18-4e9927716a88,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:16:18.826283 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '5de5065e-0ad8-4180-bd18-4e9927716a88', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'port_id': '5de5065e-0ad8-4180-bd18-4e9927716a88', 'mac_address': 'fa:16:3e:0f:ef:ce', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 538, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:16:18.868691 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12a848ee-4b65-441a-ba23-cd81e7c6f4f2 admin admin] Made reservation on behalf of 1b90b3d6739f4eef8dc3f2a78bb8a043 for: {'subnet': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:16:18.871392 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-12a848ee-4b65-441a-ba23-cd81e7c6f4f2 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5275488'] for subnet, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:18.871605 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:18.891941 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 5de5065e-0ad8-4180-bd18-4e9927716a88 {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:16:18.923879 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e6267e5-74e9-4486-b637-2579eeb6b402 admin admin] Pushing event updated for resources: {'Network': ['ID=3f528faa-b7d7-4ae6-81a7-c001fae97f70,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:18.945182 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 5de5065e-0ad8-4180-bd18-4e9927716a88, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5de5065e-0ad8-4180-bd18-4e9927716a88,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:16:18.953012 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network 3f528faa-b7d7-4ae6-81a7-c001fae97f70 details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:16:19.049385 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:19.219922 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['5de5065e-0ad8-4180-bd18-4e9927716a88'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:16:19.345197 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 59936) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:19.378847 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=5de5065e-0ad8-4180-bd18-4e9927716a88,revision_number=6']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:19.417249 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-12a848ee-4b65-441a-ba23-cd81e7c6f4f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5436401', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5275470'] for subnet, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:19.427467 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 819a44ba-1b06-406f-bec0-46cb9e3bc564 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:16:19.428432 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:19.512063 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-561ea28b-d553-4d2d-a602-06e54195ae72 req-c111354d-0fc5-44ca-98fc-96cb95829f67 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:19.514234 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-561ea28b-d553-4d2d-a602-06e54195ae72 req-c111354d-0fc5-44ca-98fc-96cb95829f67 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.1650288 Nov 11 17:16:19.566676 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 819a44ba-1b06-406f-bec0-46cb9e3bc564 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:19.567080 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:19.579848 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12a848ee-4b65-441a-ba23-cd81e7c6f4f2 admin admin] Checking segment: {'id': '92668025-4f51-4378-b7fa-fd59b584fd19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': '3f528faa-b7d7-4ae6-81a7-c001fae97f70'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:16:19.582140 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12a848ee-4b65-441a-ba23-cd81e7c6f4f2 admin admin] Network hostable DHCP agents. Network: 3f528faa-b7d7-4ae6-81a7-c001fae97f70, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:16:19.587048 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12a848ee-4b65-441a-ba23-cd81e7c6f4f2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e7b74f8a-11ae-481b-9bec-e05d84a2edc1,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:19.718318 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-561ea28b-d553-4d2d-a602-06e54195ae72 req-98b8d76f-376f-487d-8e9e-08e6a5dc4cb7 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1923614 Nov 11 17:16:19.729022 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:19.758057 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12a848ee-4b65-441a-ba23-cd81e7c6f4f2 admin admin] Network 3f528faa-b7d7-4ae6-81a7-c001fae97f70 is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:16:19.798614 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aa0bdde-8095-4f1e-8057-51a9e342221c req-a2322584-683a-4044-8cb0-29d6a7880625 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:19.811789 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4aa0bdde-8095-4f1e-8057-51a9e342221c req-a2322584-683a-4044-8cb0-29d6a7880625 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 945 time: 0.1100438 Nov 11 17:16:19.812832 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] For port 819a44ba-1b06-406f-bec0-46cb9e3bc564, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=819a44ba-1b06-406f-bec0-46cb9e3bc564,segment=NetworkSegment(5cee43f7-3e92-4b3d-a674-c03de2d33f3f),segment_id=5cee43f7-3e92-4b3d-a674-c03de2d33f3f)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:16:19.824463 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-12a848ee-4b65-441a-ba23-cd81e7c6f4f2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, 3f528faa-b7d7-4ae6-81a7-c001fae97f70) {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:16:19.826847 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12a848ee-4b65-441a-ba23-cd81e7c6f4f2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:19.827615 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-12a848ee-4b65-441a-ba23-cd81e7c6f4f2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:19.833945 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-903f6bd3-7d10-49f1-a9a6-77ccd7e87dd1 None None] Network 3f528faa-b7d7-4ae6-81a7-c001fae97f70 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:16:19.909282 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ddcbf4ab-258b-492e-a2bf-f132e5c136ef admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:19.939372 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-424501', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-397235'] for router, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:19.957769 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4aa0bdde-8095-4f1e-8057-51a9e342221c req-e57579df-7d0e-4103-a9c7-09b3a8c1a48c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1448696 Nov 11 17:16:19.961476 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-12a848ee-4b65-441a-ba23-cd81e7c6f4f2 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.1948028 Nov 11 17:16:20.015681 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:20.021986 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 170b88c1-ded4-4c5e-a307-63d78d797a5c up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:16:20.135518 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ddcbf4ab-258b-492e-a2bf-f132e5c136ef admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:20.245340 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ddcbf4ab-258b-492e-a2bf-f132e5c136ef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:20.312023 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-ddcbf4ab-258b-492e-a2bf-f132e5c136ef admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=6c607062535548eba245a09731a59175&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9653676 Nov 11 17:16:20.317213 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59974) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:20.336724 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Pushing event updated for resources: {'Port': ['ID=819a44ba-1b06-406f-bec0-46cb9e3bc564,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:20.360573 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddcbf4ab-258b-492e-a2bf-f132e5c136ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a944c896-5e1f-4697-a8b6-c2d6b5a5c917,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:20.366231 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Router c57ce69e-511d-472d-8e28-4e3c54622775 is scheduled to L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 with binding_index 1 {{(pid=102323) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 17:16:20.448067 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-acb8e477-b74e-4a93-b01e-5009d1aa75ba admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:20.461000 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 170b88c1-ded4-4c5e-a307-63d78d797a5c triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:20.461376 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:20.493861 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5364659b-b413-428c-9cfd-4a41a360f5e0 None None] Network 3f528faa-b7d7-4ae6-81a7-c001fae97f70 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:16:20.519704 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e34c2cb-e0b8-4c28-b448-0c8f580a2a86 None None] Network d863ef72-568a-44c9-9174-02dbf417bf28 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:16:20.535322 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-acb8e477-b74e-4a93-b01e-5009d1aa75ba admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:20.587396 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:16:20.620174 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Sync routers for ids ['c57ce69e-511d-472d-8e28-4e3c54622775'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:16:20.648944 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Routers {'c57ce69e-511d-472d-8e28-4e3c54622775'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:16:20.650054 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:16:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['c57ce69e-511d-472d-8e28-4e3c54622775'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:16:20.656008 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 5de5065e-0ad8-4180-bd18-4e9927716a88 up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:16:20.687185 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd45b416-fffd-4a2b-8552-ff97ddc5b5df None None] Provisioning complete for port 819a44ba-1b06-406f-bec0-46cb9e3bc564 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:20.687559 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd45b416-fffd-4a2b-8552-ff97ddc5b5df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:20.703706 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] Publish callbacks [] for router, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:20.709780 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-31e40bf6-e004-4dca-8b12-1e927f779bd6 admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 4.5593762 Nov 11 17:16:20.709780 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 59988) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:20.828680 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-acb8e477-b74e-4a93-b01e-5009d1aa75ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:20.834400 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-acb8e477-b74e-4a93-b01e-5009d1aa75ba admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:20.845605 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Set router c57ce69e-511d-472d-8e28-4e3c54622775 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:16:20.852569 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-acb8e477-b74e-4a93-b01e-5009d1aa75ba admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/a944c896-5e1f-4697-a8b6-c2d6b5a5c917 HTTP/1.1" status: 204 len: 168 time: 0.5324719 Nov 11 17:16:20.922661 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acb8e477-b74e-4a93-b01e-5009d1aa75ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a944c896-5e1f-4697-a8b6-c2d6b5a5c917,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:21.058845 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 5de5065e-0ad8-4180-bd18-4e9927716a88 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:21.059906 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:21.247110 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:21.295855 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'name': 'tempest-TestVolumeBootPattern-354798896-router', 'tenant_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.66'}], 'enable_snat': True}, 'gw_port_id': '6699bf5b-f6f9-4665-b1ea-b301a8acd3b4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:16Z', 'updated_at': '2021-11-11T17:16:18Z', 'revision_number': 3, 'project_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'gw_port': {'id': '6699bf5b-f6f9-4665-b1ea-b301a8acd3b4', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:5a:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'device_owner': 'network:router_gateway', 'standard_attr_id': 438, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:17Z', 'updated_at': '2021-11-11T17:16:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:16:21.315957 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '51c0e58c-1427-425f-ba26-73999c61ac11', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5de5065e-0ad8-4180-bd18-4e9927716a88'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:16:21.318844 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-13e4c9b5-75b0-411d-8b23-83e47d709d6c" -d '{"events": [{"server_uuid": "51c0e58c-1427-425f-ba26-73999c61ac11", "name": "network-vif-plugged", "status": "completed", "tag": "5de5065e-0ad8-4180-bd18-4e9927716a88"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:16:21.363828 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 819a44ba-1b06-406f-bec0-46cb9e3bc564 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:16:21.382380 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 5de5065e-0ad8-4180-bd18-4e9927716a88, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5de5065e-0ad8-4180-bd18-4e9927716a88,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:16:21.392955 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Checking router: c57ce69e-511d-472d-8e28-4e3c54622775 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:16:21.392955 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Updating router c57ce69e-511d-472d-8e28-4e3c54622775 port 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4 binding host dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:16:21.394828 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f01a554e-b4ab-4390-9e93-33309d6e805e req-3c05e0dd-6982-40f3-a9ed-5bcbc4a325d7 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:21.409402 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f01a554e-b4ab-4390-9e93-33309d6e805e req-3c05e0dd-6982-40f3-a9ed-5bcbc4a325d7 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 945 time: 0.1136196 Nov 11 17:16:21.435661 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:21.475844 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 819a44ba-1b06-406f-bec0-46cb9e3bc564 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:21.476219 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:21.516041 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:21.614144 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-00428942-7bf9-4f92-b159-92e6f127b28e None None] Provisioning complete for port 819a44ba-1b06-406f-bec0-46cb9e3bc564 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:21.614517 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-00428942-7bf9-4f92-b159-92e6f127b28e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:21.617864 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f01a554e-b4ab-4390-9e93-33309d6e805e req-faf8eba3-371f-4ebc-bcc7-89cfb5fca2f0 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2039926 Nov 11 17:16:21.640704 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=5de5065e-0ad8-4180-bd18-4e9927716a88,revision_number=7']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:21.759033 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:16:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3dcb3cdb-cf61-4144-af3f-d27c46d14a95 x-openstack-request-id: req-3dcb3cdb-cf61-4144-af3f-d27c46d14a95 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:16:21.759362 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "51c0e58c-1427-425f-ba26-73999c61ac11", "name": "network-vif-plugged", "status": "completed", "tag": "5de5065e-0ad8-4180-bd18-4e9927716a88", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:16:21.759625 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-3dcb3cdb-cf61-4144-af3f-d27c46d14a95 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:16:21.760030 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '51c0e58c-1427-425f-ba26-73999c61ac11', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5de5065e-0ad8-4180-bd18-4e9927716a88', 'code': 200} Nov 11 17:16:21.986964 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:22.097485 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Publish callbacks [] for port, precommit_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:22.169211 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Allocated IP 172.20.0.1 (d863ef72-568a-44c9-9174-02dbf417bf28/3ff29672-2a30-4e62-8d64-1fc0068451f0/3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:16:22.170968 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:22.239367 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Attempting to bind port 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:16:22.239810 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Attempting to bind port 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:16:22.240260 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Attempting to bind port 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4 on network 78b17769-6fae-453e-8ae3-4a72e72bccfc {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:16:22.249297 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e1d0e03-f670-430b-862e-e0efd6e782e2 None None] Pushing event updated for resources: {'Port': ['ID=6699bf5b-f6f9-4665-b1ea-b301a8acd3b4,revision_number=2']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:22.257278 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 16, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:16:22.257748 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Checking segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:16:22.258212 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:22.258684 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Bound using segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:16:22.259249 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Bound port: 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:16:22.259706 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:22.283112 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 60046) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:22.323014 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] For port 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:16:22.331049 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] For port 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=6699bf5b-f6f9-4665-b1ea-b301a8acd3b4,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:16:22.334918 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-95870d95-bcde-4b6a-a751-3a8269cafc88 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:22.392990 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:22.425920 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:22.499359 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-95870d95-bcde-4b6a-a751-3a8269cafc88 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:22.504064 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Routers {'c57ce69e-511d-472d-8e28-4e3c54622775'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:16:22.504691 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:16:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['c57ce69e-511d-472d-8e28-4e3c54622775'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:16:22.555921 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e1d0e03-f670-430b-862e-e0efd6e782e2 None None] Pushing event updated for resources: {'Port': ['ID=6699bf5b-f6f9-4665-b1ea-b301a8acd3b4,revision_number=3']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:22.605660 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:22.621234 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] Set router c57ce69e-511d-472d-8e28-4e3c54622775 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:16:22.691500 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Pushing event updated for resources: {'Port': ['ID=3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:22.697349 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-95870d95-bcde-4b6a-a751-3a8269cafc88 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:22.713095 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Network d863ef72-568a-44c9-9174-02dbf417bf28 is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:16:22.725308 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:16:22.732374 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:16:22.795386 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95870d95-bcde-4b6a-a751-3a8269cafc88 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=56a54009-039a-4303-9849-6398d76b7c84,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:22.830279 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-95870d95-bcde-4b6a-a751-3a8269cafc88 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=84f177f15b8a4712ab2685c711923771&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5426788 Nov 11 17:16:22.832809 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 60058) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:22.865621 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5375aee5-643e-4212-9c92-4056facd3bab req-67170e17-6746-4ab1-9da4-431ec909dcb6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:22.879252 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5375aee5-643e-4212-9c92-4056facd3bab req-67170e17-6746-4ab1-9da4-431ec909dcb6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.1677568 Nov 11 17:16:22.895350 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-394084'] for router_interface, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:23.002045 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'name': 'tempest-TestVolumeBootPattern-354798896-router', 'tenant_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.66'}], 'enable_snat': True}, 'gw_port_id': '6699bf5b-f6f9-4665-b1ea-b301a8acd3b4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:16Z', 'updated_at': '2021-11-11T17:16:18Z', 'revision_number': 3, 'project_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'gw_port': {'id': '6699bf5b-f6f9-4665-b1ea-b301a8acd3b4', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:5a:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'device_owner': 'network:router_gateway', 'standard_attr_id': 438, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:17Z', 'updated_at': '2021-11-11T17:16:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:16:23.035397 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5375aee5-643e-4212-9c92-4056facd3bab req-3c747917-1e36-4efe-b8ea-149d203af71d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1547856 Nov 11 17:16:23.052585 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32a957fa-67eb-4b65-977d-74edf9a018cf None None] The sync data for ids ['c57ce69e-511d-472d-8e28-4e3c54622775'] in dv-cinder-694140-2-iscsi is: [{'id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'name': 'tempest-TestVolumeBootPattern-354798896-router', 'tenant_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.66'}], 'enable_snat': True}, 'gw_port_id': '6699bf5b-f6f9-4665-b1ea-b301a8acd3b4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:16Z', 'updated_at': '2021-11-11T17:16:18Z', 'revision_number': 3, 'project_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'gw_port': {'id': '6699bf5b-f6f9-4665-b1ea-b301a8acd3b4', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:5a:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'device_owner': 'network:router_gateway', 'standard_attr_id': 438, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:17Z', 'updated_at': '2021-11-11T17:16:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:16:23.261359 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-72140f46-05eb-435c-a78a-6f4e54944b07 None None] Provisioning complete for port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:23.261954 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-72140f46-05eb-435c-a78a-6f4e54944b07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:23.340012 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-72140f46-05eb-435c-a78a-6f4e54944b07 None None] Port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:16:23.625648 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5dfd14d7-6d6a-4360-ba68-26f4cb443e35 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:23.675080 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5dfd14d7-6d6a-4360-ba68-26f4cb443e35 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:23.941841 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-93cb00f1-46e7-4a2e-939b-92a722a09841 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:23.941841 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-93cb00f1-46e7-4a2e-939b-92a722a09841 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/networks?id=3f528faa-b7d7-4ae6-81a7-c001fae97f70 HTTP/1.1" status: 200 len: 814 time: 0.3619289 Nov 11 17:16:23.941841 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:23.941841 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-f8625d7b-c12a-4071-bb48-692242ec21e8 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/quotas/1b90b3d6739f4eef8dc3f2a78bb8a043 HTTP/1.1" status: 200 len: 375 time: 0.0353673 Nov 11 17:16:23.941841 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-2f3817c4-31e5-4647-bfdb-365858a8841d tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=1b90b3d6739f4eef8dc3f2a78bb8a043&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0374444 Nov 11 17:16:24.064656 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5dfd14d7-6d6a-4360-ba68-26f4cb443e35 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:24.072619 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5dfd14d7-6d6a-4360-ba68-26f4cb443e35 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:24.080349 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-5dfd14d7-6d6a-4360-ba68-26f4cb443e35 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/56a54009-039a-4303-9849-6398d76b7c84 HTTP/1.1" status: 204 len: 168 time: 1.2439778 Nov 11 17:16:24.195741 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dfd14d7-6d6a-4360-ba68-26f4cb443e35 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=56a54009-039a-4303-9849-6398d76b7c84,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:24.236097 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5a0c14d-5bb8-45fb-a71a-81a8be9dd0b4 req-4bc5cf5c-7a45-4a39-ade2-c941250ec341 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:24.251661 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d5a0c14d-5bb8-45fb-a71a-81a8be9dd0b4 req-4bc5cf5c-7a45-4a39-ade2-c941250ec341 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.1122806 Nov 11 17:16:24.359854 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-4021c19b-6c5f-450a-b860-a89f0ca3303c service neutron] 10.222.0.16 "GET /v2.0/networks/3f528faa-b7d7-4ae6-81a7-c001fae97f70?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4046574 Nov 11 17:16:24.399917 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d5a0c14d-5bb8-45fb-a71a-81a8be9dd0b4 req-2db2964b-9168-4e97-9d5f-5b339b87695b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1419318 Nov 11 17:16:24.521211 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:24.591178 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-d07bebac-5973-4482-ad5b-c17d16b9b605 service neutron] 10.222.0.16 "GET /v2.0/networks/3f528faa-b7d7-4ae6-81a7-c001fae97f70?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2267723 Nov 11 17:16:24.594076 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:24.717937 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8103788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-394224'] for router_interface, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:24.730655 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Pushing event updated for resources: {'Port': ['ID=3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:24.883086 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Network d863ef72-568a-44c9-9174-02dbf417bf28 is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:16:24.884898 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:16:25.144276 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac0aa817-e051-4cdc-940e-05a2e9c7073a req-c2ff6fbf-b507-400a-a8d0-3ef23dd4dc1b tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 210 time: 0.0764320 Nov 11 17:16:25.165498 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Router c57ce69e-511d-472d-8e28-4e3c54622775 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:16:25.218265 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 60120) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:25.239980 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-594bbe5d-51f0-41d5-ac4c-cbd3a2f066e0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:25.402529 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-9ef8eb7c-144f-4bc2-b22f-07e09d9d59a1 None None] Provisioning complete for port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:25.403733 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-9ef8eb7c-144f-4bc2-b22f-07e09d9d59a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:25.472713 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:16:25.474687 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-594bbe5d-51f0-41d5-ac4c-cbd3a2f066e0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:25.501976 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:16:25.521790 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-2a2e87e4-0c41-434a-a4df-c08a539f137b admin admin] 10.222.0.16 "PUT /v2.0/routers/c57ce69e-511d-472d-8e28-4e3c54622775/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8125098 Nov 11 17:16:25.570293 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:25.571862 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:25.576337 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-9ef8eb7c-144f-4bc2-b22f-07e09d9d59a1 None None] Port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:16:25.579237 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-594bbe5d-51f0-41d5-ac4c-cbd3a2f066e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:25.673672 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de165253-ad7e-4325-beaf-f513b9d6515c req-79453abe-dc58-47c3-b7df-fdafd1b54972 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:25.684155 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-de165253-ad7e-4325-beaf-f513b9d6515c req-79453abe-dc58-47c3-b7df-fdafd1b54972 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.1425676 Nov 11 17:16:25.777655 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-de165253-ad7e-4325-beaf-f513b9d6515c req-e7d58558-75fa-49c6-9b42-e6bbe490c3b3 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0897169 Nov 11 17:16:25.816106 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-594bbe5d-51f0-41d5-ac4c-cbd3a2f066e0 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=9d52787f317446b097c0caab4bf7994b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5962110 Nov 11 17:16:25.819192 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 60144) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:25.822648 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-594bbe5d-51f0-41d5-ac4c-cbd3a2f066e0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e549b4c-cfcb-40da-9011-fc67a4d985d5,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:25.866757 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:25.912702 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] For port 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=6699bf5b-f6f9-4665-b1ea-b301a8acd3b4,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:16:25.940789 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Sync routers for ids ['c57ce69e-511d-472d-8e28-4e3c54622775'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:16:25.954189 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Routers {'c57ce69e-511d-472d-8e28-4e3c54622775'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:16:25.954928 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:16:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['c57ce69e-511d-472d-8e28-4e3c54622775'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:16:25.985295 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36989188-4a44-4e56-8313-91da2e5be548 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:26.004828 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:26.059339 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36989188-4a44-4e56-8313-91da2e5be548 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:26.094212 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Pushing event updated for resources: {'Port': ['ID=6699bf5b-f6f9-4665-b1ea-b301a8acd3b4,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:26.259060 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-16a06320-6fd5-4133-b2c8-1791dbe59272 req-4c05deaf-8666-4680-a015-34285298a858 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 210 time: 0.0311005 Nov 11 17:16:26.282966 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Set router c57ce69e-511d-472d-8e28-4e3c54622775 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:16:26.331305 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36989188-4a44-4e56-8313-91da2e5be548 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:26.334430 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-36989188-4a44-4e56-8313-91da2e5be548 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:26.340289 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-36989188-4a44-4e56-8313-91da2e5be548 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/7e549b4c-cfcb-40da-9011-fc67a4d985d5 HTTP/1.1" status: 204 len: 168 time: 0.5154874 Nov 11 17:16:26.359018 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36989188-4a44-4e56-8313-91da2e5be548 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e549b4c-cfcb-40da-9011-fc67a4d985d5,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:26.627842 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 60160) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:26.632908 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-c190ff39-499d-4d71-b010-7dfeb6ca9f7e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1848309604', 'description': 'tempest-secgroup-smoke-1848309604 description', 'project_id': '10bedfb35d1e481aa78e025489c1be2d'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:26.654478 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'name': 'tempest-TestVolumeBootPattern-354798896-router', 'tenant_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.66'}], 'enable_snat': True}, 'gw_port_id': '6699bf5b-f6f9-4665-b1ea-b301a8acd3b4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:16Z', 'updated_at': '2021-11-11T17:16:23Z', 'revision_number': 4, 'project_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'gw_port': {'id': '6699bf5b-f6f9-4665-b1ea-b301a8acd3b4', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:5a:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'device_owner': 'network:router_gateway', 'standard_attr_id': 438, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:17Z', 'updated_at': '2021-11-11T17:16:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf', 'name': '', 'network_id': 'd863ef72-568a-44c9-9174-02dbf417bf28', 'tenant_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'mac_address': 'fa:16:3e:cf:ca:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'device_owner': 'network:router_interface', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': '3ff29672-2a30-4e62-8d64-1fc0068451f0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:22Z', 'updated_at': '2021-11-11T17:16:23Z', 'revision_number': 2, 'project_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'subnets': [{'id': '3ff29672-2a30-4e62-8d64-1fc0068451f0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:16:26.731446 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Checking router: c57ce69e-511d-472d-8e28-4e3c54622775 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:16:26.732111 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Updating router c57ce69e-511d-472d-8e28-4e3c54622775 port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf binding host dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:16:26.747107 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c190ff39-499d-4d71-b010-7dfeb6ca9f7e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:26.761213 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:26.934720 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c190ff39-499d-4d71-b010-7dfeb6ca9f7e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:26.979164 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c190ff39-499d-4d71-b010-7dfeb6ca9f7e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:27.034490 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c190ff39-499d-4d71-b010-7dfeb6ca9f7e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a3fcdc84-afa7-461b-8091-b146ab222f62,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:27.046530 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbf91355-ff39-45fa-9d5c-1e9baeab1c29 req-e05b5b4b-fc41-4c11-88b7-4dbd88cff2b6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:27.055012 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-bbf91355-ff39-45fa-9d5c-1e9baeab1c29 req-e05b5b4b-fc41-4c11-88b7-4dbd88cff2b6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.1141710 Nov 11 17:16:27.126008 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c190ff39-499d-4d71-b010-7dfeb6ca9f7e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:27.129200 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-c190ff39-499d-4d71-b010-7dfeb6ca9f7e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.4999397 Nov 11 17:16:27.132945 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 60172) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:27.139098 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-e443a3b1-ccd5-40da-9ccd-408417d2ab15 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Request body: {'security_group_rule': {'security_group_id': 'a3fcdc84-afa7-461b-8091-b146ab222f62', 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:27.185050 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-bbf91355-ff39-45fa-9d5c-1e9baeab1c29 req-8f606f4e-b72f-4315-afd0-c56109352b35 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1287558 Nov 11 17:16:27.218469 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:16:27.280519 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e443a3b1-ccd5-40da-9ccd-408417d2ab15 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:27.376858 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Publish callbacks [] for port, precommit_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:27.390877 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:27.391470 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:27.407289 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f0b32ed3-6d1d-478a-bce8-2b5086d0a92f req-8b3491af-f522-4065-935d-9e75e6e7fe60 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 210 time: 0.0377171 Nov 11 17:16:27.409546 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e443a3b1-ccd5-40da-9ccd-408417d2ab15 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:27.460743 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:27.475314 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e443a3b1-ccd5-40da-9ccd-408417d2ab15 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:27.537395 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d18623a9-6de2-44a9-8dde-44f77f2c6d17 None None] Pushing event updated for resources: {'Port': ['ID=3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:27.556444 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e443a3b1-ccd5-40da-9ccd-408417d2ab15 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=82e10bf8-9846-4449-a9c9-cd4a0fed59c7,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:27.624787 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e443a3b1-ccd5-40da-9ccd-408417d2ab15 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:27.627471 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-e443a3b1-ccd5-40da-9ccd-408417d2ab15 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4934099 Nov 11 17:16:27.630637 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 60184) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:27.631170 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Attempting to bind port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:16:27.631701 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Attempting to bind port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '5cee43f7-3e92-4b3d-a674-c03de2d33f3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'd863ef72-568a-44c9-9174-02dbf417bf28'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:16:27.632228 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Attempting to bind port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf on network d863ef72-568a-44c9-9174-02dbf417bf28 {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:16:27.636145 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-dc297692-72fc-4e64-87b7-b409fdb3df0b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Request body: {'security_group_rule': {'security_group_id': 'a3fcdc84-afa7-461b-8091-b146ab222f62', 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:27.641389 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 16, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:16:27.642032 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Checking segment: {'id': '5cee43f7-3e92-4b3d-a674-c03de2d33f3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'd863ef72-568a-44c9-9174-02dbf417bf28'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:16:27.642431 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:27.642873 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Bound using segment: {'id': '5cee43f7-3e92-4b3d-a674-c03de2d33f3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'd863ef72-568a-44c9-9174-02dbf417bf28'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:16:27.643358 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Bound port: 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5cee43f7-3e92-4b3d-a674-c03de2d33f3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'd863ef72-568a-44c9-9174-02dbf417bf28'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:16:27.644018 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:27.756914 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-dc297692-72fc-4e64-87b7-b409fdb3df0b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:27.796550 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] For port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:16:27.801237 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] For port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf,segment=NetworkSegment(5cee43f7-3e92-4b3d-a674-c03de2d33f3f),segment_id=5cee43f7-3e92-4b3d-a674-c03de2d33f3f)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:16:27.901037 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-dc297692-72fc-4e64-87b7-b409fdb3df0b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:27.918939 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-ead5382c-8eea-4254-88a2-d4cdbe464936 None None] Provisioning complete for port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:27.919670 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ead5382c-8eea-4254-88a2-d4cdbe464936 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:27.954830 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-ead5382c-8eea-4254-88a2-d4cdbe464936 None None] Port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:16:28.150524 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:28.211979 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Routers {'c57ce69e-511d-472d-8e28-4e3c54622775'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:16:28.212752 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:16:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['c57ce69e-511d-472d-8e28-4e3c54622775'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:16:28.298832 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-dc297692-72fc-4e64-87b7-b409fdb3df0b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:28.313758 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc297692-72fc-4e64-87b7-b409fdb3df0b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d6938a06-ebe2-46bd-8fda-4d95855486e1,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:28.321918 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d18623a9-6de2-44a9-8dde-44f77f2c6d17 None None] Pushing event updated for resources: {'Port': ['ID=3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:28.340829 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b1d35de-f1de-4442-afe7-be5b5edbb30a req-85aec5f8-cd58-443e-818e-c6a995e7412c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:28.350768 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0b1d35de-f1de-4442-afe7-be5b5edbb30a req-85aec5f8-cd58-443e-818e-c6a995e7412c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.0908177 Nov 11 17:16:28.374051 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] Set router c57ce69e-511d-472d-8e28-4e3c54622775 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:16:28.404788 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-dc297692-72fc-4e64-87b7-b409fdb3df0b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:28.405926 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-dc297692-72fc-4e64-87b7-b409fdb3df0b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.7740748 Nov 11 17:16:28.409371 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 60206) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:28.417170 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-d8122f66-c7a9-4763-a946-35196b91b2c9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Request body: {'security_group_rule': {'security_group_id': 'a3fcdc84-afa7-461b-8091-b146ab222f62', 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:28.465988 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0b1d35de-f1de-4442-afe7-be5b5edbb30a req-5ef389e5-e58d-4299-9e3f-352db22dfca1 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1165667 Nov 11 17:16:28.596730 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b37b1d5c-d4cf-4d9b-8faa-aa715012d249 req-74319eb7-a554-4e8b-963b-cc322350d341 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 210 time: 0.0392454 Nov 11 17:16:28.611910 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d8122f66-c7a9-4763-a946-35196b91b2c9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:28.713048 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d8122f66-c7a9-4763-a946-35196b91b2c9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:28.753625 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-5019e60d-b07f-4550-a9ff-8ca482f90304 None None] Provisioning complete for port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:28.753625 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-5019e60d-b07f-4550-a9ff-8ca482f90304 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:28.800414 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d8122f66-c7a9-4763-a946-35196b91b2c9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:28.826024 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8122f66-c7a9-4763-a946-35196b91b2c9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bd635e7a-8cc1-4d4c-a42b-8e52c4e80fc3,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:28.888938 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d8122f66-c7a9-4763-a946-35196b91b2c9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:28.891023 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-d8122f66-c7a9-4763-a946-35196b91b2c9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4795620 Nov 11 17:16:28.893354 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 60218) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:28.900837 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-21a561af-f1bb-4eab-b0e8-1eaa28969eaa tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Request body: {'security_group_rule': {'security_group_id': 'a3fcdc84-afa7-461b-8091-b146ab222f62', 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:28.940892 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-5019e60d-b07f-4550-a9ff-8ca482f90304 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:29.010739 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-5019e60d-b07f-4550-a9ff-8ca482f90304 None None] For port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf,segment=NetworkSegment(5cee43f7-3e92-4b3d-a674-c03de2d33f3f),segment_id=5cee43f7-3e92-4b3d-a674-c03de2d33f3f)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:16:29.028071 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'name': 'tempest-TestVolumeBootPattern-354798896-router', 'tenant_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.66'}], 'enable_snat': True}, 'gw_port_id': '6699bf5b-f6f9-4665-b1ea-b301a8acd3b4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:16Z', 'updated_at': '2021-11-11T17:16:23Z', 'revision_number': 4, 'project_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'gw_port': {'id': '6699bf5b-f6f9-4665-b1ea-b301a8acd3b4', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:5a:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'device_owner': 'network:router_gateway', 'standard_attr_id': 438, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:17Z', 'updated_at': '2021-11-11T17:16:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf', 'name': '', 'network_id': 'd863ef72-568a-44c9-9174-02dbf417bf28', 'tenant_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'mac_address': 'fa:16:3e:cf:ca:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'device_owner': 'network:router_interface', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': '3ff29672-2a30-4e62-8d64-1fc0068451f0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:22Z', 'updated_at': '2021-11-11T17:16:27Z', 'revision_number': 4, 'project_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'subnets': [{'id': '3ff29672-2a30-4e62-8d64-1fc0068451f0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:16:29.063772 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-21a561af-f1bb-4eab-b0e8-1eaa28969eaa tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:29.064572 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba914503-76c9-4625-b8fe-57520ac39397 None None] The sync data for ids ['c57ce69e-511d-472d-8e28-4e3c54622775'] in dv-cinder-694140-2-iscsi is: [{'id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'name': 'tempest-TestVolumeBootPattern-354798896-router', 'tenant_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.66'}], 'enable_snat': True}, 'gw_port_id': '6699bf5b-f6f9-4665-b1ea-b301a8acd3b4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:16Z', 'updated_at': '2021-11-11T17:16:23Z', 'revision_number': 4, 'project_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'gw_port': {'id': '6699bf5b-f6f9-4665-b1ea-b301a8acd3b4', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:5a:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'device_owner': 'network:router_gateway', 'standard_attr_id': 438, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:17Z', 'updated_at': '2021-11-11T17:16:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf', 'name': '', 'network_id': 'd863ef72-568a-44c9-9174-02dbf417bf28', 'tenant_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'mac_address': 'fa:16:3e:cf:ca:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'device_owner': 'network:router_interface', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': '3ff29672-2a30-4e62-8d64-1fc0068451f0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:22Z', 'updated_at': '2021-11-11T17:16:27Z', 'revision_number': 4, 'project_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'subnets': [{'id': '3ff29672-2a30-4e62-8d64-1fc0068451f0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:16:29.142605 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-5019e60d-b07f-4550-a9ff-8ca482f90304 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:29.189402 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-21a561af-f1bb-4eab-b0e8-1eaa28969eaa tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:29.249668 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5019e60d-b07f-4550-a9ff-8ca482f90304 None None] Pushing event updated for resources: {'Port': ['ID=3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:29.256736 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-21a561af-f1bb-4eab-b0e8-1eaa28969eaa tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:29.281273 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21a561af-f1bb-4eab-b0e8-1eaa28969eaa tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=40cc845c-5efe-4c19-9afe-6468061aada1,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:29.366353 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-21a561af-f1bb-4eab-b0e8-1eaa28969eaa tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:29.371351 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-21a561af-f1bb-4eab-b0e8-1eaa28969eaa tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4732656 Nov 11 17:16:29.371534 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 60224) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:29.376426 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-73bd20b7-bc5d-4ae4-bae7-f66fd4d576e1 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Request body: {'security_group_rule': {'security_group_id': 'a3fcdc84-afa7-461b-8091-b146ab222f62', 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:29.510105 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.securitygroups_db [None req-73bd20b7-bc5d-4ae4-bae7-f66fd4d576e1 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Project 10bedfb35d1e481aa78e025489c1be2d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 17:16:29.525631 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-73bd20b7-bc5d-4ae4-bae7-f66fd4d576e1 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:29.696972 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-73bd20b7-bc5d-4ae4-bae7-f66fd4d576e1 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:29.729038 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ece8297-d9de-4cb0-94b1-10c674767b32 req-2777fdb8-460c-401e-8ab3-b42f5ab5daab tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:29.737342 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-3ece8297-d9de-4cb0-94b1-10c674767b32 req-2777fdb8-460c-401e-8ab3-b42f5ab5daab tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.1607409 Nov 11 17:16:29.780368 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4c2addf0-5742-4912-8317-47fd6f654e2f req-5326e3b0-4051-4de3-ae21-4da90c21a5ab tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 210 time: 0.0484693 Nov 11 17:16:29.781982 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-73bd20b7-bc5d-4ae4-bae7-f66fd4d576e1 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:29.807035 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73bd20b7-bc5d-4ae4-bae7-f66fd4d576e1 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=32d1ea57-6d3a-47d8-b95b-1772c5509b09,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:29.878696 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-73bd20b7-bc5d-4ae4-bae7-f66fd4d576e1 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:29.880394 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-73bd20b7-bc5d-4ae4-bae7-f66fd4d576e1 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.5078259 Nov 11 17:16:29.882709 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 60238) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:29.885253 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-3ece8297-d9de-4cb0-94b1-10c674767b32 req-f4d99aed-f3a4-4b9f-a4dc-d0ff5bd9405e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1470027 Nov 11 17:16:29.890435 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-ad4c6cf9-195f-484b-bcf9-af035e816bd6 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Request body: {'security_group_rule': {'security_group_id': 'a3fcdc84-afa7-461b-8091-b146ab222f62', 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:30.013411 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.securitygroups_db [None req-ad4c6cf9-195f-484b-bcf9-af035e816bd6 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Project 10bedfb35d1e481aa78e025489c1be2d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 17:16:30.016461 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-3354f20c-b66e-4ee9-86b7-42c1762c790a tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:30.023530 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-3354f20c-b66e-4ee9-86b7-42c1762c790a tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.10 "GET /v2.0/networks?id=3f528faa-b7d7-4ae6-81a7-c001fae97f70 HTTP/1.1" status: 200 len: 814 time: 0.3551257 Nov 11 17:16:30.023715 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ad4c6cf9-195f-484b-bcf9-af035e816bd6 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:30.035746 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-d6514f43-97d8-413d-a941-39e45d1bdf02 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Request body: {'port': {'device_id': '2303d567-a912-4483-ac64-49b3feb3aa47', 'network_id': '3f528faa-b7d7-4ae6-81a7-c001fae97f70', 'admin_state_up': True, 'tenant_id': '1b90b3d6739f4eef8dc3f2a78bb8a043'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:30.159377 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:16:30.164610 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ad4c6cf9-195f-484b-bcf9-af035e816bd6 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:30.275521 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ad4c6cf9-195f-484b-bcf9-af035e816bd6 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:30.360454 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad4c6cf9-195f-484b-bcf9-af035e816bd6 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b517d13e-6135-4310-9bd0-43e8ba9ed8e3,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:30.475175 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-d6514f43-97d8-413d-a941-39e45d1bdf02 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Made reservation on behalf of 1b90b3d6739f4eef8dc3f2a78bb8a043 for: {'port': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:16:30.479603 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-d6514f43-97d8-413d-a941-39e45d1bdf02 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:30.590135 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ad4c6cf9-195f-484b-bcf9-af035e816bd6 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:30.595101 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-ad4c6cf9-195f-484b-bcf9-af035e816bd6 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.7110977 Nov 11 17:16:30.688401 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-d6514f43-97d8-413d-a941-39e45d1bdf02 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Allocated IP 172.20.0.2 (3f528faa-b7d7-4ae6-81a7-c001fae97f70/e7b74f8a-11ae-481b-9bec-e05d84a2edc1/330af06b-68e4-4b3c-97ad-35d8cbfb0d3f) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:16:30.976619 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-70659470-456b-451c-b1f6-36ee48f25081 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:31.009786 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-d6514f43-97d8-413d-a941-39e45d1bdf02 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:31.054513 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b7e37eed-68aa-48e8-9747-7dc119f39909 req-c43dd0ce-b86c-4c37-8041-9b772f1b25d6 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 210 time: 0.0919685 Nov 11 17:16:31.128604 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c856154-a600-4b19-863a-6e23dc392fcc req-3792121c-d08b-4713-9a42-eba5fa55eff8 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:31.130775 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9c856154-a600-4b19-863a-6e23dc392fcc req-3792121c-d08b-4713-9a42-eba5fa55eff8 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.1106505 Nov 11 17:16:31.218364 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9c856154-a600-4b19-863a-6e23dc392fcc req-17d5d43f-1b23-4cc8-b5d9-282eda6c1086 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0759978 Nov 11 17:16:31.240205 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-d6514f43-97d8-413d-a941-39e45d1bdf02 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:31.267407 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-d6514f43-97d8-413d-a941-39e45d1bdf02 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Network 3f528faa-b7d7-4ae6-81a7-c001fae97f70 is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:16:31.270183 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-d6514f43-97d8-413d-a941-39e45d1bdf02 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:16:31.294574 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-d6514f43-97d8-413d-a941-39e45d1bdf02 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:16:31.304110 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:16:31.367653 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:31.368433 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:31.374501 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-d6514f43-97d8-413d-a941-39e45d1bdf02 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:31.374501 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-d6514f43-97d8-413d-a941-39e45d1bdf02 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:31.391599 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6514f43-97d8-413d-a941-39e45d1bdf02 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Pushing event updated for resources: {'Port': ['ID=330af06b-68e4-4b3c-97ad-35d8cbfb0d3f,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:31.477170 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-d6514f43-97d8-413d-a941-39e45d1bdf02 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.4453166 Nov 11 17:16:31.494612 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Request body: {'port': {'device_id': '2303d567-a912-4483-ac64-49b3feb3aa47', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:31.581615 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:32.020812 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f {{(pid=102323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:16:32.032374 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:32.065093 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.provisioning_blocks [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Transition to ACTIVE for port object 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f will not be triggered until provisioned by entity L2. {{(pid=102323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:16:32.136583 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:32.219027 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c658a3bc-6526-4898-b30c-960f51688d4f req-8d5b4da6-7e8e-491c-8850-9597aaea29f5 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:32.228942 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c658a3bc-6526-4898-b30c-960f51688d4f req-8d5b4da6-7e8e-491c-8850-9597aaea29f5 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 943 time: 0.0943506 Nov 11 17:16:32.243107 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Pushing event updated for resources: {'Port': ['ID=330af06b-68e4-4b3c-97ad-35d8cbfb0d3f,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:32.331995 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c658a3bc-6526-4898-b30c-960f51688d4f req-7f16178d-a02e-49be-b87e-dd33bf31658a tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0969732 Nov 11 17:16:32.345337 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Attempting to bind port 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:16:32.346229 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Attempting to bind port 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '92668025-4f51-4378-b7fa-fd59b584fd19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': '3f528faa-b7d7-4ae6-81a7-c001fae97f70'}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:16:32.346759 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Attempting to bind port 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f on network 3f528faa-b7d7-4ae6-81a7-c001fae97f70 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:16:32.351915 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Port 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f on network 3f528faa-b7d7-4ae6-81a7-c001fae97f70 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:16:32.353321 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Attempting to bind port 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f on network 3f528faa-b7d7-4ae6-81a7-c001fae97f70 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:16:32.370690 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 16, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:16:32.371027 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Checking segment: {'id': '92668025-4f51-4378-b7fa-fd59b584fd19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': '3f528faa-b7d7-4ae6-81a7-c001fae97f70'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:16:32.371613 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Bound using segment: {'id': '92668025-4f51-4378-b7fa-fd59b584fd19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': '3f528faa-b7d7-4ae6-81a7-c001fae97f70'} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:16:32.371945 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Bound port: 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '92668025-4f51-4378-b7fa-fd59b584fd19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': '3f528faa-b7d7-4ae6-81a7-c001fae97f70'}}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:16:32.372532 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:32.455676 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5b9121f-2574-4dd1-b38f-14e38ee2a7e9 req-966ff4a4-6223-42b7-8c77-5fdfe225e590 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:32.457720 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c5b9121f-2574-4dd1-b38f-14e38ee2a7e9 req-966ff4a4-6223-42b7-8c77-5fdfe225e590 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.0972829 Nov 11 17:16:32.508457 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] For port 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f, host hv-cinder-69414, cleared binding levels {{(pid=102323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:16:32.525391 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] For port 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=330af06b-68e4-4b3c-97ad-35d8cbfb0d3f,segment=NetworkSegment(92668025-4f51-4378-b7fa-fd59b584fd19),segment_id=92668025-4f51-4378-b7fa-fd59b584fd19)] {{(pid=102323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:16:32.553755 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c5b9121f-2574-4dd1-b38f-14e38ee2a7e9 req-1a464a6e-52e1-44e7-a326-f30b74c30b1e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0869570 Nov 11 17:16:32.600339 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:32.640387 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:32.641013 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:32.642467 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] 10.222.0.10 "PUT /v2.0/ports/330af06b-68e4-4b3c-97ad-35d8cbfb0d3f HTTP/1.1" status: 200 len: 1093 time: 1.1550665 Nov 11 17:16:32.642983 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2303d567-a912-4483-ac64-49b3feb3aa47', 'tag': '330af06b-68e4-4b3c-97ad-35d8cbfb0d3f'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:16:32.645384 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-de36d89a-e18f-46a0-a8f1-af86f2a7edfd" -d '{"events": [{"name": "network-changed", "server_uuid": "2303d567-a912-4483-ac64-49b3feb3aa47", "tag": "330af06b-68e4-4b3c-97ad-35d8cbfb0d3f"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:16:32.671831 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b7d2dee-b17a-45bc-8393-9ba1cdaf0446 service neutron] Pushing event updated for resources: {'Port': ['ID=330af06b-68e4-4b3c-97ad-35d8cbfb0d3f,revision_number=3']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:32.715503 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:16:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e579c6e8-a51c-410e-ac10-db6440c861cb x-openstack-request-id: req-e579c6e8-a51c-410e-ac10-db6440c861cb {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:16:32.715927 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2303d567-a912-4483-ac64-49b3feb3aa47", "tag": "330af06b-68e4-4b3c-97ad-35d8cbfb0d3f", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:16:32.716243 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-e579c6e8-a51c-410e-ac10-db6440c861cb {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:16:32.716714 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2303d567-a912-4483-ac64-49b3feb3aa47', 'tag': '330af06b-68e4-4b3c-97ad-35d8cbfb0d3f', 'status': 'completed', 'code': 200} Nov 11 17:16:32.804422 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de36d89a-e18f-46a0-a8f1-af86f2a7edfd req-2b33f88d-be77-4a71-b7dc-f31e7425e9b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:32.806007 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-de36d89a-e18f-46a0-a8f1-af86f2a7edfd req-2b33f88d-be77-4a71-b7dc-f31e7425e9b5 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=1b90b3d6739f4eef8dc3f2a78bb8a043&device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 1096 time: 0.0607238 Nov 11 17:16:33.039831 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de36d89a-e18f-46a0-a8f1-af86f2a7edfd req-a1546ece-4c62-4ce3-84d2-4e4a3d22c948 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:33.045956 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-de36d89a-e18f-46a0-a8f1-af86f2a7edfd req-a1546ece-4c62-4ce3-84d2-4e4a3d22c948 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=1b90b3d6739f4eef8dc3f2a78bb8a043&shared=False HTTP/1.1" status: 200 len: 915 time: 0.2243922 Nov 11 17:16:33.586050 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f53d611-b06a-4777-934e-226ca533880b req-127cd3cc-6b1e-4c60-bccc-b3a32a38d87b tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:33.587976 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0f53d611-b06a-4777-934e-226ca533880b req-127cd3cc-6b1e-4c60-bccc-b3a32a38d87b tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 943 time: 0.1186018 Nov 11 17:16:33.588502 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de36d89a-e18f-46a0-a8f1-af86f2a7edfd req-ae09e6a5-d5c6-4774-8ac8-973099623428 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:33.589829 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-de36d89a-e18f-46a0-a8f1-af86f2a7edfd req-ae09e6a5-d5c6-4774-8ac8-973099623428 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.5403917 Nov 11 17:16:33.688443 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0f53d611-b06a-4777-934e-226ca533880b req-9a575e63-f430-4622-b7e9-ee4f18328d52 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0947571 Nov 11 17:16:33.693531 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c40e13b4-6e28-42e3-bb2d-0cbda3638c54 req-7991b984-3b5e-41a9-978d-cbfc4b38190d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:33.693531 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c40e13b4-6e28-42e3-bb2d-0cbda3638c54 req-7991b984-3b5e-41a9-978d-cbfc4b38190d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.0538776 Nov 11 17:16:33.700538 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-3351f820-cb2b-4b5e-ab22-41ffb1c8f63a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:33.701982 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-3351f820-cb2b-4b5e-ab22-41ffb1c8f63a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=1b90b3d6739f4eef8dc3f2a78bb8a043&device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 1096 time: 0.0564365 Nov 11 17:16:33.747526 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c40e13b4-6e28-42e3-bb2d-0cbda3638c54 req-7d50d902-0aaa-4e54-8b50-58f698695728 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0503588 Nov 11 17:16:33.755733 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-c2524771-9487-44a0-b64a-ec6b094ea140 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=330af06b-68e4-4b3c-97ad-35d8cbfb0d3f HTTP/1.1" status: 200 len: 217 time: 0.0352139 Nov 11 17:16:33.813214 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-536a448d-68e4-4f3c-a65f-c10569e29e6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:33.814705 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-536a448d-68e4-4f3c-a65f-c10569e29e6b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=e7b74f8a-11ae-481b-9bec-e05d84a2edc1 HTTP/1.1" status: 200 len: 854 time: 0.0497863 Nov 11 17:16:33.854066 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-694aa26c-8d11-4d47-91b7-e26c34910d9b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=3f528faa-b7d7-4ae6-81a7-c001fae97f70&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0257223 Nov 11 17:16:33.930835 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-f2b70361-0319-4332-a4ba-7c0b0af7b8aa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:33.949243 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-2ceeab63-f3bf-4ac1-9915-6d5ccd63e57e service neutron] 10.222.0.10 "GET /v2.0/networks/3f528faa-b7d7-4ae6-81a7-c001fae97f70?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863762 Nov 11 17:16:34.069343 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0d8ea82e-4d64-43a0-b399-659bae109aaa req-32f3475a-e9ef-4885-b602-caecd36f1ffe service neutron] 10.222.0.10 "GET /v2.0/networks/3f528faa-b7d7-4ae6-81a7-c001fae97f70?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1076465 Nov 11 17:16:34.616369 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:34.831622 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-654811eb-e7e8-4709-9300-382356b9fa15 req-4422b12b-1c1f-42e2-9bbc-b423bc04c4b4 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:34.833326 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-654811eb-e7e8-4709-9300-382356b9fa15 req-4422b12b-1c1f-42e2-9bbc-b423bc04c4b4 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 943 time: 0.0613933 Nov 11 17:16:34.921395 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-654811eb-e7e8-4709-9300-382356b9fa15 req-065cbecf-077b-474c-9c84-263b88cc458d tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0720236 Nov 11 17:16:34.966067 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9efc2739-e863-4ed6-aff0-306634d9b738 req-93b65399-febf-44b5-be73-cddfc7691627 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:34.967749 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9efc2739-e863-4ed6-aff0-306634d9b738 req-93b65399-febf-44b5-be73-cddfc7691627 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.1285233 Nov 11 17:16:35.027194 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9efc2739-e863-4ed6-aff0-306634d9b738 req-1cbb8dc1-ec6c-4cd1-8f61-0ffe23d62d03 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0507922 Nov 11 17:16:36.099664 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a8ae2b5-225f-464c-822e-704c075d8ef7 req-ba28c772-bada-4156-83ec-cae4c365794f tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:36.101242 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7a8ae2b5-225f-464c-822e-704c075d8ef7 req-ba28c772-bada-4156-83ec-cae4c365794f tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 943 time: 0.0782702 Nov 11 17:16:36.181750 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7a8ae2b5-225f-464c-822e-704c075d8ef7 req-3543770a-2e50-4910-8eda-6beccdaab7f8 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0653102 Nov 11 17:16:36.211353 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-219d9b75-4f22-44e6-a2f4-a266ee16ffed req-2fbba0f2-0ff9-4990-b2ad-50e7e89f4090 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:36.219059 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-219d9b75-4f22-44e6-a2f4-a266ee16ffed req-2fbba0f2-0ff9-4990-b2ad-50e7e89f4090 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.0733349 Nov 11 17:16:36.283709 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-219d9b75-4f22-44e6-a2f4-a266ee16ffed req-92d6c87a-c310-4464-a737-be907e63167c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0526190 Nov 11 17:16:36.336355 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:37.295552 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1866f7b3-2eff-4331-a68e-d6a1958fe483 req-68d40b3b-c0fb-4e19-bb35-85db5d44818c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:37.297268 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1866f7b3-2eff-4331-a68e-d6a1958fe483 req-68d40b3b-c0fb-4e19-bb35-85db5d44818c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 943 time: 0.0501661 Nov 11 17:16:37.350106 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1866f7b3-2eff-4331-a68e-d6a1958fe483 req-a3338228-d922-45e0-bd2b-7f0a517656eb tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464330 Nov 11 17:16:37.382091 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:37.408003 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497aed44-e6d3-42b4-bf56-44e78b3b7d1d req-cef5f50a-930d-4fd2-b37a-7b69983a0ec7 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:37.409576 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-497aed44-e6d3-42b4-bf56-44e78b3b7d1d req-cef5f50a-930d-4fd2-b37a-7b69983a0ec7 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.0526793 Nov 11 17:16:37.461598 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-497aed44-e6d3-42b4-bf56-44e78b3b7d1d req-fe23e4b7-92f6-4669-aae2-e2031e96c8af tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455012 Nov 11 17:16:37.856723 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:16:37.985860 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=330af06b-68e4-4b3c-97ad-35d8cbfb0d3f,segment=NetworkSegment(92668025-4f51-4378-b7fa-fd59b584fd19),segment_id=92668025-4f51-4378-b7fa-fd59b584fd19)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:16:38.000136 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '330af06b-68e4-4b3c-97ad-35d8cbfb0d3f', 'network_id': '3f528faa-b7d7-4ae6-81a7-c001fae97f70', 'port_id': '330af06b-68e4-4b3c-97ad-35d8cbfb0d3f', 'mac_address': 'fa:16:3e:68:4e:86', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 508, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e7b74f8a-11ae-481b-9bec-e05d84a2edc1', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:16:38.045020 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:38.063608 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:16:38.087537 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=330af06b-68e4-4b3c-97ad-35d8cbfb0d3f,segment=NetworkSegment(92668025-4f51-4378-b7fa-fd59b584fd19),segment_id=92668025-4f51-4378-b7fa-fd59b584fd19)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:16:38.317342 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:38.366535 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=330af06b-68e4-4b3c-97ad-35d8cbfb0d3f,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:38.478401 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ed6e5c2-a0ce-4463-ad5b-d373746e911d req-4098729a-0a03-4776-859e-6e07b229ff96 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:38.480399 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8ed6e5c2-a0ce-4463-ad5b-d373746e911d req-4098729a-0a03-4776-859e-6e07b229ff96 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 944 time: 0.0559678 Nov 11 17:16:38.557021 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8ed6e5c2-a0ce-4463-ad5b-d373746e911d req-aefd5257-c4b4-4594-8712-7b75fb6555ff tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0705781 Nov 11 17:16:38.622237 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-960e87db-3715-481a-9434-363acf627e37 req-a79fbd09-b6ef-4823-a654-c415f9c8b81c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:38.623746 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-960e87db-3715-481a-9434-363acf627e37 req-a79fbd09-b6ef-4823-a654-c415f9c8b81c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.0525329 Nov 11 17:16:38.675251 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-960e87db-3715-481a-9434-363acf627e37 req-f8427b6e-88f2-4c22-b82f-77625d9f280e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453248 Nov 11 17:16:39.417385 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['330af06b-68e4-4b3c-97ad-35d8cbfb0d3f'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:16:39.697424 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-233deddf-1497-46bb-9112-dcd31d837775 req-9be7ed8e-19e0-4a3b-8416-aa2558fcd124 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:39.699478 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-233deddf-1497-46bb-9112-dcd31d837775 req-9be7ed8e-19e0-4a3b-8416-aa2558fcd124 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 944 time: 0.0608935 Nov 11 17:16:39.754009 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4658f01b-22c0-4139-98b7-b8c5d3da09d9 req-44b06a02-a77e-455d-b30d-d803427e58e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:39.755714 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4658f01b-22c0-4139-98b7-b8c5d3da09d9 req-44b06a02-a77e-455d-b30d-d803427e58e8 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=3a6e5bdc578b460ab28a883efa598f95&device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 1099 time: 0.0754800 Nov 11 17:16:39.801501 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-233deddf-1497-46bb-9112-dcd31d837775 req-df8ad36d-cfcc-4646-8c6e-76e48d5b8944 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0868068 Nov 11 17:16:39.821219 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf9dbbf-7a7d-4004-8933-48c144889b2a req-e9d75a72-4b69-454e-bfe3-3a4ab977cacf tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:39.823093 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cbf9dbbf-7a7d-4004-8933-48c144889b2a req-e9d75a72-4b69-454e-bfe3-3a4ab977cacf tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.0555446 Nov 11 17:16:39.876646 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4658f01b-22c0-4139-98b7-b8c5d3da09d9 req-c1f62f1d-ccee-4471-9972-fe65067f27dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:39.878442 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4658f01b-22c0-4139-98b7-b8c5d3da09d9 req-c1f62f1d-ccee-4471-9972-fe65067f27dd service neutron] 10.222.0.10 "GET /v2.0/networks?id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f HTTP/1.1" status: 200 len: 917 time: 0.1114352 Nov 11 17:16:39.887309 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cbf9dbbf-7a7d-4004-8933-48c144889b2a req-acac89f0-71e0-43f9-bf85-83f81517b8f5 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0507281 Nov 11 17:16:39.988354 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4658f01b-22c0-4139-98b7-b8c5d3da09d9 req-41e82252-2f92-4871-87ef-a4b7a3d61e7b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5de5065e-0ad8-4180-bd18-4e9927716a88 HTTP/1.1" status: 200 len: 1002 time: 0.1012688 Nov 11 17:16:40.060902 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4658f01b-22c0-4139-98b7-b8c5d3da09d9 req-e7f57f5d-188e-467a-a45d-699a216eaa2d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:40.062493 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4658f01b-22c0-4139-98b7-b8c5d3da09d9 req-e7f57f5d-188e-467a-a45d-699a216eaa2d service neutron] 10.222.0.10 "GET /v2.0/subnets?id=1a4b11d7-2160-49c3-be78-265f0700c580 HTTP/1.1" status: 200 len: 855 time: 0.0669234 Nov 11 17:16:40.118403 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4658f01b-22c0-4139-98b7-b8c5d3da09d9 req-fa8904af-b08c-4b78-aaf9-64e63c1e298b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:40.120874 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4658f01b-22c0-4139-98b7-b8c5d3da09d9 req-fa8904af-b08c-4b78-aaf9-64e63c1e298b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0489752 Nov 11 17:16:40.221722 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4658f01b-22c0-4139-98b7-b8c5d3da09d9 req-88f08ff9-370c-4c3c-88d9-bcfdffc1ea18 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0932901 Nov 11 17:16:40.317874 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4658f01b-22c0-4139-98b7-b8c5d3da09d9 req-a638d48c-84ce-4e17-aa23-dad5ca47ebc2 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0888875 Nov 11 17:16:40.644660 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 60516) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:40.770702 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-afb2a64e-1b42-4682-a3b6-98de4e7b5a08 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:40.884694 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-afb2a64e-1b42-4682-a3b6-98de4e7b5a08 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:40.952240 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26316466-ab75-46ff-84b6-2f169e56b312 req-014cb2b9-6977-463d-8b07-363646c3036c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:40.953952 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-26316466-ab75-46ff-84b6-2f169e56b312 req-014cb2b9-6977-463d-8b07-363646c3036c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 944 time: 0.0635307 Nov 11 17:16:40.960257 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:16:40.986101 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-afb2a64e-1b42-4682-a3b6-98de4e7b5a08 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:41.050354 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0847dff2-0d22-46fd-b38a-4227d78f8cb5 req-da052c20-fdd1-45eb-bb31-6931c66f71f4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:41.053153 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0847dff2-0d22-46fd-b38a-4227d78f8cb5 req-da052c20-fdd1-45eb-bb31-6931c66f71f4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 946 time: 0.0905404 Nov 11 17:16:41.079039 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:16:41.083632 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afb2a64e-1b42-4682-a3b6-98de4e7b5a08 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8992afb7-0472-4325-a20d-f9749ec8bd19,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:41.084041 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:41.084604 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:41.090997 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-afb2a64e-1b42-4682-a3b6-98de4e7b5a08 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=df71ee1e35a44f0191dcd04c01e72c08&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4448450 Nov 11 17:16:41.093080 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 60534) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:41.115508 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-26316466-ab75-46ff-84b6-2f169e56b312 req-b6474e0b-2576-4b11-af28-8341f8b5a713 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1529286 Nov 11 17:16:41.126496 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0847dff2-0d22-46fd-b38a-4227d78f8cb5 req-878d17a3-b5e9-45ae-a0e4-06ee543c7b03 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0642676 Nov 11 17:16:41.189366 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4a1e3279-bf10-4d6d-a53f-8400ce1c6dfc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:41.211018 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:41.214488 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4a1e3279-bf10-4d6d-a53f-8400ce1c6dfc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:41.236508 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2303d567-a912-4483-ac64-49b3feb3aa47', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '330af06b-68e4-4b3c-97ad-35d8cbfb0d3f'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:16:41.239239 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d86a85c4-5942-4220-a991-cafd48e5aace" -d '{"events": [{"server_uuid": "2303d567-a912-4483-ac64-49b3feb3aa47", "name": "network-vif-plugged", "status": "completed", "tag": "330af06b-68e4-4b3c-97ad-35d8cbfb0d3f"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:16:41.261528 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=330af06b-68e4-4b3c-97ad-35d8cbfb0d3f,segment=NetworkSegment(92668025-4f51-4378-b7fa-fd59b584fd19),segment_id=92668025-4f51-4378-b7fa-fd59b584fd19)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:16:41.279791 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:16:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fc20451d-5d32-42ca-9e26-c2f1d8a7a7fd x-openstack-request-id: req-fc20451d-5d32-42ca-9e26-c2f1d8a7a7fd {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:16:41.279905 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2303d567-a912-4483-ac64-49b3feb3aa47", "name": "network-vif-plugged", "status": "completed", "tag": "330af06b-68e4-4b3c-97ad-35d8cbfb0d3f", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:16:41.280089 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-fc20451d-5d32-42ca-9e26-c2f1d8a7a7fd {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:16:41.280641 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2303d567-a912-4483-ac64-49b3feb3aa47', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '330af06b-68e4-4b3c-97ad-35d8cbfb0d3f', 'code': 200} Nov 11 17:16:41.365332 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:41.366399 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 5de5065e-0ad8-4180-bd18-4e9927716a88 no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:16:41.395000 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4a1e3279-bf10-4d6d-a53f-8400ce1c6dfc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:41.400169 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4a1e3279-bf10-4d6d-a53f-8400ce1c6dfc admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:41.404242 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-4a1e3279-bf10-4d6d-a53f-8400ce1c6dfc admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/8992afb7-0472-4325-a20d-f9749ec8bd19 HTTP/1.1" status: 204 len: 168 time: 0.3073285 Nov 11 17:16:41.415776 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a1e3279-bf10-4d6d-a53f-8400ce1c6dfc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8992afb7-0472-4325-a20d-f9749ec8bd19,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:41.489268 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=330af06b-68e4-4b3c-97ad-35d8cbfb0d3f,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:41.533223 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:41.568427 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 5de5065e-0ad8-4180-bd18-4e9927716a88, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5de5065e-0ad8-4180-bd18-4e9927716a88,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:16:41.667741 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:41.719777 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=5de5065e-0ad8-4180-bd18-4e9927716a88,revision_number=8']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:41.902423 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a61b8cbe-251f-4c38-ad17-691727551161 req-3d21f74b-3f54-4536-9af0-41dd5ded7d09 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:41.904024 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a61b8cbe-251f-4c38-ad17-691727551161 req-3d21f74b-3f54-4536-9af0-41dd5ded7d09 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0587475 Nov 11 17:16:41.965337 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a61b8cbe-251f-4c38-ad17-691727551161 req-f81f0c9c-5f27-439c-9c53-9b277182e151 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0542634 Nov 11 17:16:42.114394 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 60562) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:42.128143 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9569d7ee-27d9-4c32-a121-dab68e428786 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:42.266638 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e31d2b75-b81a-4abf-8ff9-28919ad99ec0 req-0a7f3295-0965-4c8e-b54f-7e7f06d2d5ce tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:42.268165 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e31d2b75-b81a-4abf-8ff9-28919ad99ec0 req-0a7f3295-0965-4c8e-b54f-7e7f06d2d5ce tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 945 time: 0.0560992 Nov 11 17:16:42.272777 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9569d7ee-27d9-4c32-a121-dab68e428786 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:42.301029 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fefaf4be-72d2-4b94-bdd6-0492211479bd req-a9d8466c-6324-472a-ab7b-b17e566c652b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:42.302592 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fefaf4be-72d2-4b94-bdd6-0492211479bd req-a9d8466c-6324-472a-ab7b-b17e566c652b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0620658 Nov 11 17:16:42.326010 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e31d2b75-b81a-4abf-8ff9-28919ad99ec0 req-5ec5d832-9453-4718-9710-f68db2df570e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498514 Nov 11 17:16:42.330422 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9569d7ee-27d9-4c32-a121-dab68e428786 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:42.385505 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-9569d7ee-27d9-4c32-a121-dab68e428786 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=1f4858f0e9344557922fc70f7157d0d6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2698350 Nov 11 17:16:42.388848 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 60574) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:42.401342 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9569d7ee-27d9-4c32-a121-dab68e428786 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=411b871f-16c2-4e46-af4e-a160b16ec98f,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:42.408462 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fefaf4be-72d2-4b94-bdd6-0492211479bd req-19ae05d4-2ec8-4a2f-99a5-ede71e9aad81 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0979388 Nov 11 17:16:42.448793 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-45d6e124-5fdc-4d2f-a013-c7772c22dbf5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:42.472475 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-45d6e124-5fdc-4d2f-a013-c7772c22dbf5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:42.576439 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-45d6e124-5fdc-4d2f-a013-c7772c22dbf5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:42.579726 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-45d6e124-5fdc-4d2f-a013-c7772c22dbf5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:42.581338 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-45d6e124-5fdc-4d2f-a013-c7772c22dbf5 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/411b871f-16c2-4e46-af4e-a160b16ec98f HTTP/1.1" status: 204 len: 168 time: 0.1914456 Nov 11 17:16:42.592313 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45d6e124-5fdc-4d2f-a013-c7772c22dbf5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=411b871f-16c2-4e46-af4e-a160b16ec98f,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:42.694331 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 60580) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:42.811212 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-da187c32-48e5-4fbc-88f7-c45b77a3c5f0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:42.891062 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-da187c32-48e5-4fbc-88f7-c45b77a3c5f0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:42.981791 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-da187c32-48e5-4fbc-88f7-c45b77a3c5f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:43.026651 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-da187c32-48e5-4fbc-88f7-c45b77a3c5f0 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=7c547cfc08f04fe3a7bbd5fe890899df&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3305931 Nov 11 17:16:43.028640 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da187c32-48e5-4fbc-88f7-c45b77a3c5f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f5bf903b-68ad-47c2-ace4-88a65c6fcdc4,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:43.030915 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 60590) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:43.088941 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-22709f48-5b16-4273-b912-a6884673b5be admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:43.098778 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc3a30d9-921a-4ab1-a4d8-9ad96de7870a req-246b3783-fe0f-4f71-906e-ff367ee4c030 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:43.100700 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bc3a30d9-921a-4ab1-a4d8-9ad96de7870a req-246b3783-fe0f-4f71-906e-ff367ee4c030 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0498743 Nov 11 17:16:43.112358 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-22709f48-5b16-4273-b912-a6884673b5be admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:43.154424 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bc3a30d9-921a-4ab1-a4d8-9ad96de7870a req-eb474f08-e6b6-45de-a6db-e79d7f2060f3 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463176 Nov 11 17:16:43.238986 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-22709f48-5b16-4273-b912-a6884673b5be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:43.241673 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-22709f48-5b16-4273-b912-a6884673b5be admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:43.242843 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-22709f48-5b16-4273-b912-a6884673b5be admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/f5bf903b-68ad-47c2-ace4-88a65c6fcdc4 HTTP/1.1" status: 204 len: 168 time: 0.2095678 Nov 11 17:16:43.254098 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22709f48-5b16-4273-b912-a6884673b5be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5bf903b-68ad-47c2-ace4-88a65c6fcdc4,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:43.281435 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '51c0e58c-1427-425f-ba26-73999c61ac11', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '5de5065e-0ad8-4180-bd18-4e9927716a88'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:16:43.284484 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e532bfa3-df46-4ac0-8510-93eedd737c1d" -d '{"events": [{"server_uuid": "51c0e58c-1427-425f-ba26-73999c61ac11", "name": "network-vif-unplugged", "status": "completed", "tag": "5de5065e-0ad8-4180-bd18-4e9927716a88"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:16:43.309390 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 60600) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:43.322739 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 11 Nov 2021 17:16:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc5aea73-ed48-447c-bab3-0c8f196845ff x-openstack-request-id: req-cc5aea73-ed48-447c-bab3-0c8f196845ff {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:16:43.323180 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "51c0e58c-1427-425f-ba26-73999c61ac11", "name": "network-vif-unplugged", "status": "completed", "tag": "5de5065e-0ad8-4180-bd18-4e9927716a88", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:16:43.323329 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-cc5aea73-ed48-447c-bab3-0c8f196845ff {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:16:43.323676 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '51c0e58c-1427-425f-ba26-73999c61ac11', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '5de5065e-0ad8-4180-bd18-4e9927716a88', 'code': 200} Nov 11 17:16:43.324636 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c783d62a-987d-4a9c-9982-7dbe4e12c60e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:43.419755 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c783d62a-987d-4a9c-9982-7dbe4e12c60e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:43.468339 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786aec16-eb78-4977-8034-13ca8ad5df65 req-7f25445c-9c8d-44af-a527-16f9780963a2 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:43.470200 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-786aec16-eb78-4977-8034-13ca8ad5df65 req-7f25445c-9c8d-44af-a527-16f9780963a2 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 945 time: 0.0676129 Nov 11 17:16:43.501996 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c783d62a-987d-4a9c-9982-7dbe4e12c60e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:43.534689 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-786aec16-eb78-4977-8034-13ca8ad5df65 req-0098ed3d-c99e-4a53-9550-c033ef6aebd0 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556948 Nov 11 17:16:43.585371 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-c783d62a-987d-4a9c-9982-7dbe4e12c60e admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=9b120e4df5c742d5b4623340825aa939&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2748151 Nov 11 17:16:43.587049 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c783d62a-987d-4a9c-9982-7dbe4e12c60e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc2344b2-c263-41c4-8599-de1b86471cf7,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:43.588502 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 60606) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:43.628395 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71c65ad5-f05c-439c-a0a9-40ca81b3d40b req-8f378c05-a172-4523-9d35-bc7eb24da584 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:43.630924 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-71c65ad5-f05c-439c-a0a9-40ca81b3d40b req-8f378c05-a172-4523-9d35-bc7eb24da584 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.1119249 Nov 11 17:16:43.664514 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9a5588b7-c026-459d-beb2-55c928541844 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:43.691584 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9a5588b7-c026-459d-beb2-55c928541844 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:43.713066 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-71c65ad5-f05c-439c-a0a9-40ca81b3d40b req-a0163935-4dd1-48a5-a440-b02006f952af tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0722530 Nov 11 17:16:43.822004 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9a5588b7-c026-459d-beb2-55c928541844 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:43.825429 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-9a5588b7-c026-459d-beb2-55c928541844 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:43.826852 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-9a5588b7-c026-459d-beb2-55c928541844 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/cc2344b2-c263-41c4-8599-de1b86471cf7 HTTP/1.1" status: 204 len: 168 time: 0.2360022 Nov 11 17:16:43.837899 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a5588b7-c026-459d-beb2-55c928541844 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc2344b2-c263-41c4-8599-de1b86471cf7,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:44.353230 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-030e6398-4f98-4ee9-aaa5-cb2ba65ab83c req-b6876aa7-4ad1-4093-ac31-2d156f7c1fdd tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:44.355794 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-030e6398-4f98-4ee9-aaa5-cb2ba65ab83c req-b6876aa7-4ad1-4093-ac31-2d156f7c1fdd tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0712016 Nov 11 17:16:44.407219 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-030e6398-4f98-4ee9-aaa5-cb2ba65ab83c req-93ba0ee6-04bc-4535-b096-30386fc4c364 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446112 Nov 11 17:16:44.693971 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7115a42-417b-462f-9b54-2f8a463ec058 req-80a77927-55e9-4301-a7f9-a79f33dc6420 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:44.695653 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e7115a42-417b-462f-9b54-2f8a463ec058 req-80a77927-55e9-4301-a7f9-a79f33dc6420 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 945 time: 0.0883825 Nov 11 17:16:44.704868 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5950fdee-e0af-48c1-9de6-59a443938860 req-309fd41d-d70b-4985-978b-6031cbcb4083 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:44.706431 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5950fdee-e0af-48c1-9de6-59a443938860 req-309fd41d-d70b-4985-978b-6031cbcb4083 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 1098 time: 0.0676985 Nov 11 17:16:44.721701 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be927e6f-5f55-4a3d-bd0a-f6d2ed504c28 req-b4271cc5-f882-46c4-91aa-a31ecd32f21e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:44.724135 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-be927e6f-5f55-4a3d-bd0a-f6d2ed504c28 req-b4271cc5-f882-46c4-91aa-a31ecd32f21e service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ed26d137d98846b9b45708f7e581e9b0&device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 1098 time: 0.0561838 Nov 11 17:16:44.796549 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5950fdee-e0af-48c1-9de6-59a443938860 req-c55fa04e-bf82-4ac4-bfaf-abde1d740d3c service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0818181 Nov 11 17:16:44.800611 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e7115a42-417b-462f-9b54-2f8a463ec058 req-7eede0b9-9088-4b73-9f37-d32276bf01de tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0931988 Nov 11 17:16:44.919371 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be927e6f-5f55-4a3d-bd0a-f6d2ed504c28 req-bfabee7e-6e02-4500-a6f0-12501ceb67a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:44.920816 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-be927e6f-5f55-4a3d-bd0a-f6d2ed504c28 req-bfabee7e-6e02-4500-a6f0-12501ceb67a2 service neutron] 10.222.0.10 "GET /v2.0/networks?id=983bda4c-112d-442d-b37a-387818bb1d45 HTTP/1.1" status: 200 len: 919 time: 0.1825621 Nov 11 17:16:44.928498 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d7a3cfe-98b2-4064-b7e4-615e3852462d req-b7a80c24-9a8f-4a34-8a57-8aa9fb65d887 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:44.929965 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6d7a3cfe-98b2-4064-b7e4-615e3852462d req-b7a80c24-9a8f-4a34-8a57-8aa9fb65d887 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0869672 Nov 11 17:16:44.982418 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6d7a3cfe-98b2-4064-b7e4-615e3852462d req-9cdbdf5a-860c-4f97-b44a-d48f117223bc tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446959 Nov 11 17:16:45.106027 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-be927e6f-5f55-4a3d-bd0a-f6d2ed504c28 req-2880e925-30bd-4c79-9792-ba25352b56dd service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=904b538c-2fcd-42a3-bc02-26c84d4d00cb HTTP/1.1" status: 200 len: 217 time: 0.0425377 Nov 11 17:16:45.168415 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be927e6f-5f55-4a3d-bd0a-f6d2ed504c28 req-aa90e60f-6c00-4352-9e2d-7ab19d922487 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:45.171453 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-be927e6f-5f55-4a3d-bd0a-f6d2ed504c28 req-aa90e60f-6c00-4352-9e2d-7ab19d922487 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4 HTTP/1.1" status: 200 len: 858 time: 0.0558963 Nov 11 17:16:45.211331 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-be927e6f-5f55-4a3d-bd0a-f6d2ed504c28 req-d411cc79-5d93-46cd-bf42-6493d45caa76 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=983bda4c-112d-442d-b37a-387818bb1d45&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0313480 Nov 11 17:16:45.342910 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-be927e6f-5f55-4a3d-bd0a-f6d2ed504c28 req-3cfd4c8c-ce43-468b-957a-98e3aa7f12c5 service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1188164 Nov 11 17:16:45.519265 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-be927e6f-5f55-4a3d-bd0a-f6d2ed504c28 req-a784f066-b693-4530-9fa7-71e4cf20f4d5 service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1673801 Nov 11 17:16:45.616801 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e17e6844-3575-46ba-b373-914765419dc9 req-b062cf48-0a6d-4d87-89d8-db1fc878996d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:45.618502 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e17e6844-3575-46ba-b373-914765419dc9 req-b062cf48-0a6d-4d87-89d8-db1fc878996d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.1028254 Nov 11 17:16:45.686981 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e17e6844-3575-46ba-b373-914765419dc9 req-5448593f-e57d-4583-93df-95c9d569cd4a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566196 Nov 11 17:16:45.974360 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cdc3872-ecd0-43c6-9ef1-8a703720f063 req-50e64f33-e974-4ff2-9a10-f884fc090fb0 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:45.975858 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8cdc3872-ecd0-43c6-9ef1-8a703720f063 req-50e64f33-e974-4ff2-9a10-f884fc090fb0 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 945 time: 0.0859113 Nov 11 17:16:46.112669 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8cdc3872-ecd0-43c6-9ef1-8a703720f063 req-2153cc9c-4730-451c-b458-7f214b058b5b tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1291709 Nov 11 17:16:46.281701 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e92c6ccc-1faa-42bc-8fba-e33990b32447 req-738bb35f-09d7-4aa1-8074-0fa1d29a6d2d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:46.291634 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e92c6ccc-1faa-42bc-8fba-e33990b32447 req-738bb35f-09d7-4aa1-8074-0fa1d29a6d2d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.1192417 Nov 11 17:16:46.373535 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e92c6ccc-1faa-42bc-8fba-e33990b32447 req-2c4907a7-9f16-4e15-b40c-44799be2a8b7 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0801964 Nov 11 17:16:46.856344 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e7d8262-9f00-4ced-a8e7-96303b890e61 req-be9feb1d-e9b3-446d-bc36-a82f8a5da29e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:46.858574 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5e7d8262-9f00-4ced-a8e7-96303b890e61 req-be9feb1d-e9b3-446d-bc36-a82f8a5da29e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0539486 Nov 11 17:16:46.873545 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:46.918514 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5e7d8262-9f00-4ced-a8e7-96303b890e61 req-e7bd051f-cda9-4bd9-bf06-a7c3ed590a4b tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530219 Nov 11 17:16:47.278856 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01417bc1-5135-4b91-93c2-187a218a87f1 req-9e973065-d58e-41ce-8957-b4e2e9db9bec tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:47.281494 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-01417bc1-5135-4b91-93c2-187a218a87f1 req-9e973065-d58e-41ce-8957-b4e2e9db9bec tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 945 time: 0.0879993 Nov 11 17:16:47.374507 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-01417bc1-5135-4b91-93c2-187a218a87f1 req-ee67b617-cbbc-4555-9a4b-c8dbe630f141 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0805664 Nov 11 17:16:47.872822 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-ab4609b9-cb06-4f50-b946-9f29a9c9725e tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/networks?tenant_id=20af76921cde4b01b02a3b8aef4f7e37&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0596805 Nov 11 17:16:48.106099 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ad942b-c2e2-4ea8-8365-9dd41c3d6468 req-f36710f6-7e63-4f31-a28d-5d1686630f01 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:48.110337 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-19ad942b-c2e2-4ea8-8365-9dd41c3d6468 req-f36710f6-7e63-4f31-a28d-5d1686630f01 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0803127 Nov 11 17:16:48.181169 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-cb9328c5-f95f-4a11-ae5b-fcaea825c847 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:48.182899 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-cb9328c5-f95f-4a11-ae5b-fcaea825c847 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3042977 Nov 11 17:16:48.197056 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-19ad942b-c2e2-4ea8-8365-9dd41c3d6468 req-b78177f3-d728-43a6-936a-2e2a0c768688 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0747571 Nov 11 17:16:48.206158 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-e80351d4-11ea-43be-bbdb-1b838f062e04 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/quotas/20af76921cde4b01b02a3b8aef4f7e37 HTTP/1.1" status: 200 len: 375 time: 0.0109098 Nov 11 17:16:48.258483 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-9a385bfc-709f-4242-8abc-d412d2045cfe tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=20af76921cde4b01b02a3b8aef4f7e37&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0427341 Nov 11 17:16:48.353191 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [req-f7e7fd62-d413-4f68-b494-6a017b32b23e req-dfe85204-fa45-40f3-8f69-5e17819c94b8 service neutron] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=102324) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 17:16:48.355533 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f7e7fd62-d413-4f68-b494-6a017b32b23e req-dfe85204-fa45-40f3-8f69-5e17819c94b8 service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0096397 Nov 11 17:16:48.635913 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6441b476-ae35-46db-8d19-75428c92d94d req-186ebdbe-24b4-44df-8414-0644aab4de99 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 210 time: 0.0626087 Nov 11 17:16:48.884469 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-352d5de0-2f23-49fe-9058-a5c2b2dc0483 req-4b10ffeb-7707-4d2c-a5d2-a23ca248bc0d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:48.887108 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-352d5de0-2f23-49fe-9058-a5c2b2dc0483 req-4b10ffeb-7707-4d2c-a5d2-a23ca248bc0d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0533423 Nov 11 17:16:48.957224 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-352d5de0-2f23-49fe-9058-a5c2b2dc0483 req-e25eb55c-685a-42eb-975c-6737319607c3 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0605094 Nov 11 17:16:49.342885 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1380b50b-4a92-4abf-9ed6-492e36248aeb req-9c2a3e88-0496-459e-9414-9f6eb1ccb074 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:49.344681 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1380b50b-4a92-4abf-9ed6-492e36248aeb req-9c2a3e88-0496-459e-9414-9f6eb1ccb074 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0605664 Nov 11 17:16:49.403723 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1380b50b-4a92-4abf-9ed6-492e36248aeb req-fcb41884-6ebc-4fd0-9666-e0c735e18993 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525496 Nov 11 17:16:49.584209 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 60864) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:49.695706 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e868b7e2-9cba-4a8f-8531-57cdc8be03be req-ef290256-8a6e-464d-97c4-bda389fdcf28 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1103184 Nov 11 17:16:49.706719 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [req-e868b7e2-9cba-4a8f-8531-57cdc8be03be req-d0a0f70b-547b-40ec-ae56-f1c036a80ae5 service neutron] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=102323) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 17:16:49.707707 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e868b7e2-9cba-4a8f-8531-57cdc8be03be req-d0a0f70b-547b-40ec-ae56-f1c036a80ae5 service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0051398 Nov 11 17:16:49.731797 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4bd80d0f-5518-41cf-a9a6-ca71aaf65ed5 req-ea54afe6-04fa-43da-84f3-e084d1f7a6da tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 210 time: 0.0425780 Nov 11 17:16:50.110890 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426274d8-2e74-4670-82eb-a96e89be8546 req-07bbb9c7-380e-45e0-bed6-cb1a7ac8c169 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:50.113603 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-426274d8-2e74-4670-82eb-a96e89be8546 req-07bbb9c7-380e-45e0-bed6-cb1a7ac8c169 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0583613 Nov 11 17:16:50.173543 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-426274d8-2e74-4670-82eb-a96e89be8546 req-282c2a75-14c0-4628-8e2b-33f4255ca375 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0525796 Nov 11 17:16:50.537586 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef052e51-64ce-4ba8-9cc3-1f88c4f43eb5 req-7928ec1f-b18d-4ecc-9064-0fce390d4414 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:50.540474 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ef052e51-64ce-4ba8-9cc3-1f88c4f43eb5 req-7928ec1f-b18d-4ecc-9064-0fce390d4414 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0608146 Nov 11 17:16:50.599774 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ef052e51-64ce-4ba8-9cc3-1f88c4f43eb5 req-1f333cc1-1358-40b5-bf69-c2d21ff3cba9 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504770 Nov 11 17:16:50.833906 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a3ced2e9-c246-48d8-a33e-fe2074f72bb5 req-40e9f68c-367d-4530-85f4-4e0d88f6a0cc tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 210 time: 0.0282872 Nov 11 17:16:51.106952 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 5de5065e-0ad8-4180-bd18-4e9927716a88 no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:16:51.319585 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ad12a85-be99-496b-9034-dd7886971edb req-042fbd1c-cd71-4465-9e50-0ff8cf7d5378 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:51.321877 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1ad12a85-be99-496b-9034-dd7886971edb req-042fbd1c-cd71-4465-9e50-0ff8cf7d5378 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0572157 Nov 11 17:16:51.384559 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1ad12a85-be99-496b-9034-dd7886971edb req-387c5c42-5ce7-413a-a14d-c462f44515c0 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0543497 Nov 11 17:16:51.756378 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2af2790-60e8-4deb-8599-3149e0500454 req-2e3e9834-940d-4aeb-b5b2-5ac4651f9415 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:51.762233 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d2af2790-60e8-4deb-8599-3149e0500454 req-2e3e9834-940d-4aeb-b5b2-5ac4651f9415 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0642633 Nov 11 17:16:51.808975 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d2af2790-60e8-4deb-8599-3149e0500454 req-13593e3b-25de-46db-9acc-4430df2c96fe tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440915 Nov 11 17:16:51.930277 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e5854a70-14bb-4f05-ae5b-834acedf3aca req-266e8a62-b3d8-4aee-959b-2925724b6de3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 210 time: 0.0265753 Nov 11 17:16:52.579896 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04e391da-f436-436c-a2e0-2a968af00e44 req-9bd73482-1198-4425-b955-7ef28b93ae79 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:52.581728 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-04e391da-f436-436c-a2e0-2a968af00e44 req-9bd73482-1198-4425-b955-7ef28b93ae79 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0842783 Nov 11 17:16:52.668643 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-04e391da-f436-436c-a2e0-2a968af00e44 req-e44a1013-ffe4-4035-914c-c4eab7f78888 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0697806 Nov 11 17:16:52.950870 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48cf0b62-e550-4f9c-adba-23063cd4b1b9 req-4e830040-6dab-42c6-a737-64824e0cd5a4 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:52.953356 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-48cf0b62-e550-4f9c-adba-23063cd4b1b9 req-4e830040-6dab-42c6-a737-64824e0cd5a4 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0551953 Nov 11 17:16:53.031771 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-48cf0b62-e550-4f9c-adba-23063cd4b1b9 req-641870db-1a14-485d-aed1-a3b017b51a59 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0614216 Nov 11 17:16:53.089485 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-659a3b11-76f0-4739-9193-a8a2c831bf2a req-b7f10304-e18d-4840-8f84-760835384449 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 210 time: 0.0587628 Nov 11 17:16:53.246116 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-0bb1da3e-f93a-41f3-8aaa-8470f4cd4dc7 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.10 "GET /v2.0/networks?tenant_id=20af76921cde4b01b02a3b8aef4f7e37&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0377116 Nov 11 17:16:53.467909 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-6501469f-603e-4361-b4a6-0c18ccbb7635 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:53.470663 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-6501469f-603e-4361-b4a6-0c18ccbb7635 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2174499 Nov 11 17:16:53.490531 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Request body: {'port': {'device_id': '012d9d04-cb70-46f9-869f-49b2eaefd62e', 'network_id': '5cc951aa-501f-4b44-a0ad-11046541b62a', 'admin_state_up': True, 'tenant_id': '20af76921cde4b01b02a3b8aef4f7e37'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:53.814028 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f85d253-43a7-46cc-9d00-7559c4f346b6 req-2fe7249d-d92d-4136-846b-cfb02257644b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:53.815839 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5f85d253-43a7-46cc-9d00-7559c4f346b6 req-2fe7249d-d92d-4136-846b-cfb02257644b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0520988 Nov 11 17:16:53.821168 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Made reservation on behalf of 20af76921cde4b01b02a3b8aef4f7e37 for: {'port': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:16:53.835478 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:53.868151 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:53.951072 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5f85d253-43a7-46cc-9d00-7559c4f346b6 req-56582c66-cf18-4dd0-80e5-1921bed30541 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1210427 Nov 11 17:16:54.026470 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:54.125141 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:54.227660 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd9ee23-1d9d-4f54-a1ca-78878fee5281 req-ce21ab1a-3c71-4505-a1c2-7fbf09244b37 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:54.235124 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ecd9ee23-1d9d-4f54-a1ca-78878fee5281 req-ce21ab1a-3c71-4505-a1c2-7fbf09244b37 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0642130 Nov 11 17:16:54.295210 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ecd9ee23-1d9d-4f54-a1ca-78878fee5281 req-395b566e-95c8-4e0e-a7d9-20123c8370ae tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590255 Nov 11 17:16:54.329390 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e018e78d-0adc-4845-9c0e-645f25f748d0 req-e8cc27d2-e739-4a49-9caf-4fab50897912 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 210 time: 0.1380911 Nov 11 17:16:54.335816 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Pushing event updated for resources: {'SecurityGroup': ['ID=16fa915a-0ce2-4da9-888b-efc8cf40e573,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:54.428153 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Allocated IP 192.168.233.102 (5cc951aa-501f-4b44-a0ad-11046541b62a/b1116129-689a-47aa-b946-b2cf91d8a485/e137bc22-ff95-4ab6-8968-d2101235153c) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:16:54.594896 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:54.707609 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:54.750123 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Network 5cc951aa-501f-4b44-a0ad-11046541b62a is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:16:54.756448 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:16:54.761027 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:16:54.794274 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Pushing event updated for resources: {'Port': ['ID=e137bc22-ff95-4ab6-8968-d2101235153c,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:54.828831 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:54.829608 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:54.939177 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-ecdfcacd-4776-49c5-92f7-9dcd796c6962 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.4576542 Nov 11 17:16:54.954915 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Request body: {'port': {'device_id': '012d9d04-cb70-46f9-869f-49b2eaefd62e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:16:54.982716 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e868b7e2-9cba-4a8f-8531-57cdc8be03be req-128d237e-2214-494f-90b6-a374323a48c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:55.002105 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e868b7e2-9cba-4a8f-8531-57cdc8be03be req-128d237e-2214-494f-90b6-a374323a48c2 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11&tenant_id=3a6e5bdc578b460ab28a883efa598f95 HTTP/1.1" status: 200 len: 1097 time: 0.2232928 Nov 11 17:16:55.032298 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 60984) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:55.047753 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:55.100157 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-e3339c49-8b66-4d51-9e97-6e0ec519d140 None None] Provisioning complete for port e137bc22-ff95-4ab6-8968-d2101235153c triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:16:55.105399 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-e3339c49-8b66-4d51-9e97-6e0ec519d140 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:55.142629 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e868b7e2-9cba-4a8f-8531-57cdc8be03be req-543afaf5-0763-4e80-9a96-8be7c0b480a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:55.146585 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e868b7e2-9cba-4a8f-8531-57cdc8be03be req-543afaf5-0763-4e80-9a96-8be7c0b480a3 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=3a6e5bdc578b460ab28a883efa598f95&device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 1097 time: 0.0998478 Nov 11 17:16:55.166791 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a8644db-4b6e-4665-a8bf-e0d0a4fa73f1 req-40bdad4b-c582-4352-96b0-7399a75beea2 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:55.170601 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9a8644db-4b6e-4665-a8bf-e0d0a4fa73f1 req-40bdad4b-c582-4352-96b0-7399a75beea2 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.1015289 Nov 11 17:16:55.196411 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-e3339c49-8b66-4d51-9e97-6e0ec519d140 None None] Port e137bc22-ff95-4ab6-8968-d2101235153c cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:16:55.284683 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-acc0157f-0cb9-4cc3-b1f3-66325de7b77b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:55.326266 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9a8644db-4b6e-4665-a8bf-e0d0a4fa73f1 req-bf4b2636-028f-4f5d-8c83-9d1e5b889c18 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1308000 Nov 11 17:16:55.374496 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e868b7e2-9cba-4a8f-8531-57cdc8be03be req-6ea04161-19e8-4b65-8ace-976f1c4ff8c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:55.375757 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e868b7e2-9cba-4a8f-8531-57cdc8be03be req-6ea04161-19e8-4b65-8ace-976f1c4ff8c1 service neutron] 10.222.0.10 "GET /v2.0/networks?id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f HTTP/1.1" status: 200 len: 917 time: 0.2042220 Nov 11 17:16:55.397029 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e137bc22-ff95-4ab6-8968-d2101235153c {{(pid=102324) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:16:55.406820 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:55.437303 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.provisioning_blocks [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Transition to ACTIVE for port object e137bc22-ff95-4ab6-8968-d2101235153c will not be triggered until provisioned by entity L2. {{(pid=102324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:16:55.496160 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76949ecf-a517-445d-a358-67eec7fac503 req-e82437d5-972c-4a36-80a8-21b00448ec88 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:55.497945 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-76949ecf-a517-445d-a358-67eec7fac503 req-e82437d5-972c-4a36-80a8-21b00448ec88 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0760412 Nov 11 17:16:55.524571 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-acc0157f-0cb9-4cc3-b1f3-66325de7b77b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:55.526922 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e868b7e2-9cba-4a8f-8531-57cdc8be03be req-045a2937-8f75-4b27-b5ae-94ec633db5cd service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5de5065e-0ad8-4180-bd18-4e9927716a88 HTTP/1.1" status: 200 len: 1000 time: 0.1424932 Nov 11 17:16:55.546876 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef5f4dd4-da86-492d-b65a-3e2e9b4f7769 req-ae6ba7a1-8d70-4f13-8f24-46e36a3b1164 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:55.548563 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ef5f4dd4-da86-492d-b65a-3e2e9b4f7769 req-ae6ba7a1-8d70-4f13-8f24-46e36a3b1164 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 936 time: 0.1028736 Nov 11 17:16:55.561465 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-76949ecf-a517-445d-a358-67eec7fac503 req-d4e407b9-f504-469f-8628-fcc2f8b56761 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545905 Nov 11 17:16:55.570173 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:55.626363 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e868b7e2-9cba-4a8f-8531-57cdc8be03be req-0e576750-5534-4c0a-83a8-3717f51d1b1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:55.627874 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e868b7e2-9cba-4a8f-8531-57cdc8be03be req-0e576750-5534-4c0a-83a8-3717f51d1b1c service neutron] 10.222.0.10 "GET /v2.0/subnets?id=1a4b11d7-2160-49c3-be78-265f0700c580 HTTP/1.1" status: 200 len: 855 time: 0.0784173 Nov 11 17:16:55.644803 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Pushing event updated for resources: {'Port': ['ID=e137bc22-ff95-4ab6-8968-d2101235153c,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:55.702267 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Attempting to bind port e137bc22-ff95-4ab6-8968-d2101235153c on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:16:55.702632 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Attempting to bind port e137bc22-ff95-4ab6-8968-d2101235153c by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '5cc951aa-501f-4b44-a0ad-11046541b62a'}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:16:55.702973 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Attempting to bind port e137bc22-ff95-4ab6-8968-d2101235153c on network 5cc951aa-501f-4b44-a0ad-11046541b62a {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:16:55.708496 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Port e137bc22-ff95-4ab6-8968-d2101235153c on network 5cc951aa-501f-4b44-a0ad-11046541b62a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:16:55.708826 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Attempting to bind port e137bc22-ff95-4ab6-8968-d2101235153c on network 5cc951aa-501f-4b44-a0ad-11046541b62a {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:16:55.714986 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 16, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:16:55.715327 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Checking segment: {'id': '6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '5cc951aa-501f-4b44-a0ad-11046541b62a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:16:55.715700 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Bound using segment: {'id': '6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '5cc951aa-501f-4b44-a0ad-11046541b62a'} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:16:55.716145 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Bound port: e137bc22-ff95-4ab6-8968-d2101235153c, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '5cc951aa-501f-4b44-a0ad-11046541b62a'}}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:16:55.716499 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:55.808947 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] For port e137bc22-ff95-4ab6-8968-d2101235153c, host hv-cinder-69414, cleared binding levels {{(pid=102324) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:16:55.814620 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] For port e137bc22-ff95-4ab6-8968-d2101235153c, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=e137bc22-ff95-4ab6-8968-d2101235153c,segment=NetworkSegment(6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf),segment_id=6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf)] {{(pid=102324) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:16:55.884605 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:55.914069 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-acc0157f-0cb9-4cc3-b1f3-66325de7b77b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:55.919326 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ef5f4dd4-da86-492d-b65a-3e2e9b4f7769 req-f7cacab5-c097-4043-a5c3-0804e6bb8920 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3608594 Nov 11 17:16:55.935992 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:55.936963 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:55.938236 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] 10.222.0.10 "PUT /v2.0/ports/e137bc22-ff95-4ab6-8968-d2101235153c HTTP/1.1" status: 200 len: 1098 time: 0.9896598 Nov 11 17:16:55.938779 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '012d9d04-cb70-46f9-869f-49b2eaefd62e', 'tag': 'e137bc22-ff95-4ab6-8968-d2101235153c'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:16:55.941199 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f22b2c36-56ef-4234-9f2b-54359a204b2b" -d '{"events": [{"name": "network-changed", "server_uuid": "012d9d04-cb70-46f9-869f-49b2eaefd62e", "tag": "e137bc22-ff95-4ab6-8968-d2101235153c"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:16:55.989189 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1adb1b73-22b1-4f94-b5d1-da4b11951023 service neutron] Pushing event updated for resources: {'Port': ['ID=e137bc22-ff95-4ab6-8968-d2101235153c,revision_number=3']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:55.992725 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acc0157f-0cb9-4cc3-b1f3-66325de7b77b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fd2bbdb0-c987-4575-ac57-fab1f9313677,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:56.006448 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-acc0157f-0cb9-4cc3-b1f3-66325de7b77b admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=9de64ce3e5334c68862683fdd1a48867&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9670308 Nov 11 17:16:56.007046 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:16:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ca5f9b97-8cab-49cf-b5c2-016512b9b196 x-openstack-request-id: req-ca5f9b97-8cab-49cf-b5c2-016512b9b196 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:16:56.007046 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "012d9d04-cb70-46f9-869f-49b2eaefd62e", "tag": "e137bc22-ff95-4ab6-8968-d2101235153c", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:16:56.007046 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-ca5f9b97-8cab-49cf-b5c2-016512b9b196 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:16:56.007046 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '012d9d04-cb70-46f9-869f-49b2eaefd62e', 'tag': 'e137bc22-ff95-4ab6-8968-d2101235153c', 'status': 'completed', 'code': 200} Nov 11 17:16:56.007046 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 32772) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:16:56.011011 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e868b7e2-9cba-4a8f-8531-57cdc8be03be req-e97a8e19-6133-4a60-90db-4b2bc5f81170 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:56.023766 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e868b7e2-9cba-4a8f-8531-57cdc8be03be req-e97a8e19-6133-4a60-90db-4b2bc5f81170 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3876507 Nov 11 17:16:56.101291 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bfc7bfd4-2f9d-48c2-9f84-9168cddbc7bc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:56.105425 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f22b2c36-56ef-4234-9f2b-54359a204b2b req-f0aaff1d-021b-4673-a2aa-062b7bbec494 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:56.106942 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f22b2c36-56ef-4234-9f2b-54359a204b2b req-f0aaff1d-021b-4673-a2aa-062b7bbec494 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=20af76921cde4b01b02a3b8aef4f7e37&device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 1101 time: 0.0812624 Nov 11 17:16:56.187284 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f22b2c36-56ef-4234-9f2b-54359a204b2b req-961208bc-f399-4310-8d2f-5d70a5dfa72a service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=20af76921cde4b01b02a3b8aef4f7e37&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0688446 Nov 11 17:16:56.194119 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e868b7e2-9cba-4a8f-8531-57cdc8be03be req-79f81209-fe23-4101-a828-97c5847ad527 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1602862 Nov 11 17:16:56.273021 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bfc7bfd4-2f9d-48c2-9f84-9168cddbc7bc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:56.306535 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e868b7e2-9cba-4a8f-8531-57cdc8be03be req-0b40ec09-7951-4bed-bd18-be22bfcf4b09 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0946088 Nov 11 17:16:56.534406 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9ae2eb-6660-4141-b809-dd424ad293c0 req-ebfcf672-1486-4a60-b690-1b367d14970f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:56.536273 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5f9ae2eb-6660-4141-b809-dd424ad293c0 req-ebfcf672-1486-4a60-b690-1b367d14970f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0548499 Nov 11 17:16:56.604560 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5f9ae2eb-6660-4141-b809-dd424ad293c0 req-aa0dae2f-cf8e-4e5f-a0e0-6645177aa012 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0580845 Nov 11 17:16:56.695266 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f22b2c36-56ef-4234-9f2b-54359a204b2b req-1c768f23-064e-4710-ba92-17645758b609 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:56.696616 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f22b2c36-56ef-4234-9f2b-54359a204b2b req-1c768f23-064e-4710-ba92-17645758b609 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4947660 Nov 11 17:16:56.718205 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a84c483-c05e-4f7c-bb88-6431ebc27e34 req-33b5eed3-6188-4883-a292-baf433665802 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:56.719578 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9a84c483-c05e-4f7c-bb88-6431ebc27e34 req-33b5eed3-6188-4883-a292-baf433665802 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0620749 Nov 11 17:16:56.807757 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9a84c483-c05e-4f7c-bb88-6431ebc27e34 req-8321d166-3543-4250-9331-ec0e460d9d4f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0789616 Nov 11 17:16:56.814283 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-2e371abe-c453-445e-acf1-13a2947b3c5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:56.816329 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-2e371abe-c453-445e-acf1-13a2947b3c5b service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=20af76921cde4b01b02a3b8aef4f7e37&device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 1101 time: 0.0704381 Nov 11 17:16:56.823420 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bfc7bfd4-2f9d-48c2-9f84-9168cddbc7bc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:56.826168 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bfc7bfd4-2f9d-48c2-9f84-9168cddbc7bc admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:16:56.827301 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-bfc7bfd4-2f9d-48c2-9f84-9168cddbc7bc admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/fd2bbdb0-c987-4575-ac57-fab1f9313677 HTTP/1.1" status: 204 len: 168 time: 0.8222077 Nov 11 17:16:56.872951 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc7bfd4-2f9d-48c2-9f84-9168cddbc7bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd2bbdb0-c987-4575-ac57-fab1f9313677,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:16:56.875458 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-6d7391f6-e953-471b-ba1c-f0fafd6260c3 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.102&port_id=e137bc22-ff95-4ab6-8968-d2101235153c HTTP/1.1" status: 200 len: 217 time: 0.0471275 Nov 11 17:16:56.931263 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-d9a57b95-f54b-419e-84cb-f98890d7c0c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:56.933235 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-d9a57b95-f54b-419e-84cb-f98890d7c0c7 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=b1116129-689a-47aa-b946-b2cf91d8a485 HTTP/1.1" status: 200 len: 843 time: 0.0507033 Nov 11 17:16:56.988669 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-f5617742-6898-4eb6-9f92-375a02796b07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:56.990275 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-f5617742-6898-4eb6-9f92-375a02796b07 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=5cc951aa-501f-4b44-a0ad-11046541b62a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0494325 Nov 11 17:16:57.061200 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39414308-caf8-44e8-8f60-d886b3e4ea47 req-71aeb68d-833a-44c3-b4a9-ca3662083d4d tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:57.069042 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-39414308-caf8-44e8-8f60-d886b3e4ea47 req-71aeb68d-833a-44c3-b4a9-ca3662083d4d tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 948 time: 0.0767398 Nov 11 17:16:57.197273 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-d9045476-338a-4b64-bd3c-1f8e435fba22 service neutron] 10.222.0.10 "GET /v2.0/networks/5cc951aa-501f-4b44-a0ad-11046541b62a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1915684 Nov 11 17:16:57.200442 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-39414308-caf8-44e8-8f60-d886b3e4ea47 req-03059e7a-80f3-429e-9bc4-07b8aced6334 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1291654 Nov 11 17:16:57.700423 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-6f3db262-4bbf-4598-b3e7-1b59e1f4f0e7 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1848309604&fields=id&tenant_id=10bedfb35d1e481aa78e025489c1be2d HTTP/1.1" status: 200 len: 267 time: 0.0833375 Nov 11 17:16:57.786404 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd96f24-fb65-4172-a844-96ec5dfa357c req-b8358342-b028-4434-8daf-96e7adf6262e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:57.790301 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-3fd96f24-fb65-4172-a844-96ec5dfa357c req-b8358342-b028-4434-8daf-96e7adf6262e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0818028 Nov 11 17:16:57.877439 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-33c40089-91ce-4a82-9738-a1595278b1c4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:57.878921 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-33c40089-91ce-4a82-9738-a1595278b1c4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/networks?id=45e6626a-2007-490b-a445-d7c3baea689e HTTP/1.1" status: 200 len: 811 time: 0.1781170 Nov 11 17:16:57.895711 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-0b690daf-fc43-4425-8225-eceb6dd845f2 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/quotas/10bedfb35d1e481aa78e025489c1be2d HTTP/1.1" status: 200 len: 375 time: 0.0103545 Nov 11 17:16:57.912534 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-3fd96f24-fb65-4172-a844-96ec5dfa357c req-88b5f452-3478-4161-85a1-ba2d15c923c5 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1093011 Nov 11 17:16:58.007052 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-82f59c9d-f8f6-4911-9c92-86fac6c4d7c4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0888052 Nov 11 17:16:58.068574 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3d6d25f-2e49-4a60-b8fe-d6667287ad09 req-640ca8af-680c-41af-9c7f-c1572bc9c4ab tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:58.070285 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e3d6d25f-2e49-4a60-b8fe-d6667287ad09 req-640ca8af-680c-41af-9c7f-c1572bc9c4ab tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0625210 Nov 11 17:16:58.123066 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-ef4a2433-afff-4642-a40a-eb85bde82ca4 service neutron] 10.222.0.16 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1138864 Nov 11 17:16:58.153039 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e3d6d25f-2e49-4a60-b8fe-d6667287ad09 req-6e9b1223-753c-4bc5-b5ed-a8ec246f5523 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0755627 Nov 11 17:16:58.239704 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-9df95146-2371-4fdf-a078-dee8617d80c7 service neutron] 10.222.0.16 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1088400 Nov 11 17:16:58.351970 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e2eb886-9e31-45b3-9fcb-18c9b177ac8b req-f1ada49b-ea5f-467b-80d3-65e61bcdbcb5 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:58.353552 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7e2eb886-9e31-45b3-9fcb-18c9b177ac8b req-f1ada49b-ea5f-467b-80d3-65e61bcdbcb5 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 948 time: 0.0619907 Nov 11 17:16:58.439522 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7e2eb886-9e31-45b3-9fcb-18c9b177ac8b req-f9abffa0-03ac-4555-b45b-a40c306b190f tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0770173 Nov 11 17:16:58.945448 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-3b2da21d-4938-425f-86cf-f6611098a130 req-4b99b0c6-d39f-48c8-8878-e4fc9965c9b5 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 210 time: 0.0277770 Nov 11 17:16:59.076908 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0073c296-655e-4aaf-a4f3-187753b69469 req-3d0683fc-68b8-4cca-b886-6edede3459cb tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:59.078535 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0073c296-655e-4aaf-a4f3-187753b69469 req-3d0683fc-68b8-4cca-b886-6edede3459cb tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0856340 Nov 11 17:16:59.154818 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0073c296-655e-4aaf-a4f3-187753b69469 req-32d0e9af-7bca-4ec7-94f8-ba4ae841e230 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0626481 Nov 11 17:16:59.291466 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b008a6f0-9b4d-4a86-a787-8c16b7266fe8 req-f79df4f9-a6a6-46bc-bf8d-ddaa28be93b1 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:59.295340 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b008a6f0-9b4d-4a86-a787-8c16b7266fe8 req-f79df4f9-a6a6-46bc-bf8d-ddaa28be93b1 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0581789 Nov 11 17:16:59.349450 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b008a6f0-9b4d-4a86-a787-8c16b7266fe8 req-7ddbe7c1-5fd0-4a2c-b236-a8ae1427d1fd tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498815 Nov 11 17:16:59.595422 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-731382ff-2c7a-4023-9f64-f94e495f405a req-4455fee6-22d5-4eb4-af4e-b9615221f7de tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:16:59.597031 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-731382ff-2c7a-4023-9f64-f94e495f405a req-4455fee6-22d5-4eb4-af4e-b9615221f7de tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 948 time: 0.0818639 Nov 11 17:16:59.682382 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-731382ff-2c7a-4023-9f64-f94e495f405a req-86e3239d-09d7-4dcb-b6e2-0a9e4aa10642 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0741897 Nov 11 17:17:00.059198 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6bc14d9a-6d7d-4af8-867c-a7dd34d72204 req-c8dfff11-c9e8-44bd-b72d-598a844984ba tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 210 time: 0.0445542 Nov 11 17:17:00.269986 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e462bbd-28d1-42dd-83e7-43b34309e0e2 req-4767dce2-08a0-4aa0-aa69-f760ba61cc7a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:00.271639 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e462bbd-28d1-42dd-83e7-43b34309e0e2 req-4767dce2-08a0-4aa0-aa69-f760ba61cc7a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0520549 Nov 11 17:17:00.323152 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e462bbd-28d1-42dd-83e7-43b34309e0e2 req-93f8828c-3922-4d37-8971-c02e900ca356 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452898 Nov 11 17:17:00.516458 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868d096f-b7ce-44cb-af86-8092b3de33e9 req-415864a5-5773-4fd9-88fe-8284b4e95a0a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:00.516458 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-868d096f-b7ce-44cb-af86-8092b3de33e9 req-415864a5-5773-4fd9-88fe-8284b4e95a0a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0618412 Nov 11 17:17:00.550285 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-868d096f-b7ce-44cb-af86-8092b3de33e9 req-bc6fad95-23dc-4883-bf6a-2413fdcc2f62 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0583827 Nov 11 17:17:00.842105 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71b04f01-b09d-4839-8a67-c84a43d0edbe req-8c6712d6-a786-4ec4-91ae-07a7a996c886 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:00.843679 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-71b04f01-b09d-4839-8a67-c84a43d0edbe req-8c6712d6-a786-4ec4-91ae-07a7a996c886 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 948 time: 0.0595634 Nov 11 17:17:00.897731 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-71b04f01-b09d-4839-8a67-c84a43d0edbe req-eb106d8b-6815-4d40-9a92-353b4b62e488 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479624 Nov 11 17:17:01.096861 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ac3c3e10-dc2c-4ce4-894f-58e19d998f5a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:01.170294 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-aeffe108-fdbd-482a-bebf-b002b300ccac req-f49db5e2-7064-4c44-8979-31b6420a2f70 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 210 time: 0.0268812 Nov 11 17:17:01.456010 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b78ef1c-3394-4636-8c47-8f35d283b6f1 req-93314a45-1c4d-49da-a991-8fc924e24047 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:01.457499 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2b78ef1c-3394-4636-8c47-8f35d283b6f1 req-93314a45-1c4d-49da-a991-8fc924e24047 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0602987 Nov 11 17:17:01.514256 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2b78ef1c-3394-4636-8c47-8f35d283b6f1 req-90757f29-e8c1-4dd9-b623-8fbc805bc51a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0499878 Nov 11 17:17:01.842110 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1f25ade-9559-4609-a7b3-24644b7babb0 req-bbfeccf4-bbf1-4fa4-9f4a-7f77e14587cd tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:01.843649 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c1f25ade-9559-4609-a7b3-24644b7babb0 req-bbfeccf4-bbf1-4fa4-9f4a-7f77e14587cd tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0718479 Nov 11 17:17:01.892117 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c1f25ade-9559-4609-a7b3-24644b7babb0 req-a56e9a44-7632-4389-a1c2-aabf394bca83 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423748 Nov 11 17:17:02.024608 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8254976d-6208-46e9-b36e-d10c3cb59c92 req-b01f07ea-5571-4cab-9322-ef2478ff9eaa tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:02.026860 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8254976d-6208-46e9-b36e-d10c3cb59c92 req-b01f07ea-5571-4cab-9322-ef2478ff9eaa tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 948 time: 0.0537100 Nov 11 17:17:02.078734 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8254976d-6208-46e9-b36e-d10c3cb59c92 req-46742ee8-180d-44fd-aa0b-ddc9d14126e4 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454230 Nov 11 17:17:02.270491 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9523ef22-e0ba-483b-a48a-4a299e732678 req-4fb4a39f-f151-40f9-8b7a-9e4a046c109c tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 210 time: 0.0310407 Nov 11 17:17:02.667104 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24d5d890-89c4-4fba-97e1-a8abaf20779c req-495b817d-9402-43d9-9682-5ebf515e5657 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:02.668668 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-24d5d890-89c4-4fba-97e1-a8abaf20779c req-495b817d-9402-43d9-9682-5ebf515e5657 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0753262 Nov 11 17:17:02.721980 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-24d5d890-89c4-4fba-97e1-a8abaf20779c req-3f54a5fb-a9c1-42c8-8a73-718e18e8feb8 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465267 Nov 11 17:17:03.022424 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-620ebaff-1034-4780-b0e5-011706d6b6a6 req-f67c2656-b5af-4acb-b3b9-19caf8c73df5 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:03.023943 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-620ebaff-1034-4780-b0e5-011706d6b6a6 req-f67c2656-b5af-4acb-b3b9-19caf8c73df5 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0498698 Nov 11 17:17:03.081843 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-620ebaff-1034-4780-b0e5-011706d6b6a6 req-0a491acb-f26d-4792-b68b-3b2899ed6c92 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486076 Nov 11 17:17:03.229234 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31eda21b-c723-43a9-b3ca-0a55026c68c1 req-9303551a-6cf3-48ce-9c67-9616fd2b18a5 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:03.230825 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-31eda21b-c723-43a9-b3ca-0a55026c68c1 req-9303551a-6cf3-48ce-9c67-9616fd2b18a5 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 948 time: 0.0574024 Nov 11 17:17:03.283674 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-31eda21b-c723-43a9-b3ca-0a55026c68c1 req-4df57ed4-2d7b-4390-a1e8-5ee09c23a63b tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467355 Nov 11 17:17:03.383280 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0423c18f-56d1-4573-b078-e0851b1c00b4 req-6281494d-5d3d-4b91-843e-6ca8914f91aa tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 210 time: 0.0347538 Nov 11 17:17:03.521389 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-106cf258-afa0-4a9f-8d62-d4f87826f0c6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:03.864340 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d3b2fc-0c9e-4b63-942b-8ff506b78d34 req-0173b3c5-62f1-454d-9b0b-ae1e260f6d40 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:03.869083 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-33d3b2fc-0c9e-4b63-942b-8ff506b78d34 req-0173b3c5-62f1-454d-9b0b-ae1e260f6d40 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0569127 Nov 11 17:17:03.918291 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-33d3b2fc-0c9e-4b63-942b-8ff506b78d34 req-e76101fb-384f-49ed-9cf7-1076e2a33a68 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441566 Nov 11 17:17:04.211536 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-296287ab-2523-4fcd-82a9-bb0d6baba1d4 req-468b0290-4784-40c9-853b-2424a84834c6 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:04.213514 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-296287ab-2523-4fcd-82a9-bb0d6baba1d4 req-468b0290-4784-40c9-853b-2424a84834c6 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0588779 Nov 11 17:17:04.266764 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-296287ab-2523-4fcd-82a9-bb0d6baba1d4 req-e5f99fc0-6530-497d-9756-914ee355f595 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465329 Nov 11 17:17:04.428657 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5721e8a-9cfb-4e1d-940c-408bfc1d4791 req-8ab26c55-77b1-48c1-8689-61a44981eabd tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:04.430631 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b5721e8a-9cfb-4e1d-940c-408bfc1d4791 req-8ab26c55-77b1-48c1-8689-61a44981eabd tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 948 time: 0.0601714 Nov 11 17:17:04.508490 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b5721e8a-9cfb-4e1d-940c-408bfc1d4791 req-143e8172-12a9-4313-9672-e94ef391acd5 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695159 Nov 11 17:17:04.531682 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-85b93fa1-3a30-47a1-898a-d985ecc142b7 req-6a93b313-f095-4462-ac14-6c972e46a40d tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 210 time: 0.0398839 Nov 11 17:17:04.552197 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:05.072055 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52cc4151-cb81-4519-863b-52b7712f2371 req-30e7a301-4ae2-4581-a366-0c5ef9ce7a57 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:05.075070 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-52cc4151-cb81-4519-863b-52b7712f2371 req-30e7a301-4ae2-4581-a366-0c5ef9ce7a57 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0513430 Nov 11 17:17:05.127924 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-52cc4151-cb81-4519-863b-52b7712f2371 req-4c90d350-19dc-4599-86ed-081331ad0351 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459421 Nov 11 17:17:05.414982 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9259a5aa-350c-4c5c-ab71-51328199cfa1 req-eba19871-e285-4514-9717-ce0db7620223 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:05.417057 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9259a5aa-350c-4c5c-ab71-51328199cfa1 req-eba19871-e285-4514-9717-ce0db7620223 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0772233 Nov 11 17:17:05.484188 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9259a5aa-350c-4c5c-ab71-51328199cfa1 req-8a6d02c8-9144-42fb-896d-15e7af23defc tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0604424 Nov 11 17:17:05.651242 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-119f62c3-67e8-420f-88cd-5c7a6d4dd2b8 req-f5a53ac1-60c5-4702-bbe7-ac9e415fb8ae tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:05.652877 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-119f62c3-67e8-420f-88cd-5c7a6d4dd2b8 req-f5a53ac1-60c5-4702-bbe7-ac9e415fb8ae tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 948 time: 0.0817890 Nov 11 17:17:05.653105 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-265ecb59-a810-4738-bc82-236324a82078 req-4a56d3e8-7030-4238-9b7c-47ea79eea898 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 210 time: 0.0359497 Nov 11 17:17:05.706907 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-119f62c3-67e8-420f-88cd-5c7a6d4dd2b8 req-7050e02e-de08-4f11-91b4-a5d9ddbf727e tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474861 Nov 11 17:17:06.282795 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d3c32c-700d-4741-9bc6-6e6ee743a769 req-031c85ce-5d24-4c4c-8e20-ebd2184ee117 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:06.284618 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b7d3c32c-700d-4741-9bc6-6e6ee743a769 req-031c85ce-5d24-4c4c-8e20-ebd2184ee117 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0772271 Nov 11 17:17:06.332732 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:06.336083 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b7d3c32c-700d-4741-9bc6-6e6ee743a769 req-6a04c212-976e-4209-bde9-d269683112f4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449920 Nov 11 17:17:06.625386 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61d481aa-289c-4b0b-933e-5fed268a6c8f req-be00313f-72bf-425f-a4b7-838c1f0bd76d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:06.626904 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-61d481aa-289c-4b0b-933e-5fed268a6c8f req-be00313f-72bf-425f-a4b7-838c1f0bd76d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0632217 Nov 11 17:17:06.691075 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-61d481aa-289c-4b0b-933e-5fed268a6c8f req-0e2e0863-4976-4d64-8357-c80ee42dec0d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574207 Nov 11 17:17:06.759994 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-db7979ad-6b63-4ae7-8d4c-72eb897577c3 req-86e4f7a6-00b2-4760-89d5-480f6a68be36 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 210 time: 0.0269954 Nov 11 17:17:06.854283 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66909821-f2d0-4386-889a-6e790c1f0c82 req-3c0a4aee-8561-4e0d-ab7b-496a7daa933a tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:06.856317 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-66909821-f2d0-4386-889a-6e790c1f0c82 req-3c0a4aee-8561-4e0d-ab7b-496a7daa933a tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 948 time: 0.0611138 Nov 11 17:17:06.920022 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-66909821-f2d0-4386-889a-6e790c1f0c82 req-11ba15fd-60b7-497f-a763-b61d2d201b75 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509582 Nov 11 17:17:07.102828 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:07.138685 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:17:07.474712 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a610d2-4fb9-4cc0-bc58-0893a0893c01 req-f8175881-22b3-4aac-adfa-0d97c748af84 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:07.476596 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-51a610d2-4fb9-4cc0-bc58-0893a0893c01 req-f8175881-22b3-4aac-adfa-0d97c748af84 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0544639 Nov 11 17:17:07.527120 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-51a610d2-4fb9-4cc0-bc58-0893a0893c01 req-67d38abf-2888-4e32-b14e-17daeb43fba9 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425539 Nov 11 17:17:07.856382 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daf3c015-9834-4f49-b274-156f0169b5be req-ae8fe956-0d23-4ea6-817a-0b547ae3534c tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:07.858022 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-daf3c015-9834-4f49-b274-156f0169b5be req-ae8fe956-0d23-4ea6-817a-0b547ae3534c tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0900495 Nov 11 17:17:07.865612 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2f6616c5-61f9-4fec-b062-57619b8f9a22 req-5250b8db-cc78-4bdb-9f3b-38c92beb1f38 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 210 time: 0.0259950 Nov 11 17:17:07.920219 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-daf3c015-9834-4f49-b274-156f0169b5be req-ab7895d6-26c3-4497-8e32-e290a0f62d4d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0526915 Nov 11 17:17:08.051519 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92cdca49-d0d4-4d33-9a47-10c3951b44da req-b1575dbd-4d07-4a06-814f-1bf4a1262d4b tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:08.053084 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-92cdca49-d0d4-4d33-9a47-10c3951b44da req-b1575dbd-4d07-4a06-814f-1bf4a1262d4b tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 948 time: 0.0591938 Nov 11 17:17:08.105751 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-92cdca49-d0d4-4d33-9a47-10c3951b44da req-4eb2a6e2-ae2e-4b65-b3ae-9148e3c01e28 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457840 Nov 11 17:17:08.649751 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2270bfa5-f440-4dfa-b369-98ded4d12cc0 req-6a17679a-c7cf-4971-8005-d87c3c381abb tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:08.651840 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2270bfa5-f440-4dfa-b369-98ded4d12cc0 req-6a17679a-c7cf-4971-8005-d87c3c381abb tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0501511 Nov 11 17:17:08.699382 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2270bfa5-f440-4dfa-b369-98ded4d12cc0 req-62e9f60e-f914-42c8-a6a5-d83c8160c016 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412378 Nov 11 17:17:08.991145 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e4931fc4-7d7e-4c1c-95e7-1b53ba362650 req-0e3261d0-3b31-4670-aa38-fc505a7140e6 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 210 time: 0.0333602 Nov 11 17:17:09.047682 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0cafea3-8470-4e6e-b792-75b929142336 req-b4799576-6eba-49a2-9044-bec050b1c92a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:09.049744 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b0cafea3-8470-4e6e-b792-75b929142336 req-b4799576-6eba-49a2-9044-bec050b1c92a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0522678 Nov 11 17:17:09.108743 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b0cafea3-8470-4e6e-b792-75b929142336 req-5ecf48b4-1f81-47f0-ad7f-511bcbd32566 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516677 Nov 11 17:17:09.254981 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5412456-0f9b-47e6-8379-d03086beb918 req-deb328b6-3e94-4a28-b6ff-2a7900991a65 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:09.256566 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c5412456-0f9b-47e6-8379-d03086beb918 req-deb328b6-3e94-4a28-b6ff-2a7900991a65 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 948 time: 0.0810788 Nov 11 17:17:09.263327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bcad4e0-d4f5-4202-8aa8-99320d3842bc req-adc642be-3223-4334-b3e7-b59ec2f9b5de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:09.264804 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-3bcad4e0-d4f5-4202-8aa8-99320d3842bc req-adc642be-3223-4334-b3e7-b59ec2f9b5de service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 1098 time: 0.0781913 Nov 11 17:17:09.291726 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d41ffdfe-5622-44ea-98dc-7833966ded98 req-2bfb054d-bafd-435c-b094-5d00edf76273 service neutron] 10.222.0.10 "GET /v2.0/networks/5cc951aa-501f-4b44-a0ad-11046541b62a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1004717 Nov 11 17:17:09.337801 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c5412456-0f9b-47e6-8379-d03086beb918 req-214ae406-754f-4e3b-ae3b-15ae69597758 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0720072 Nov 11 17:17:09.352286 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-3bcad4e0-d4f5-4202-8aa8-99320d3842bc req-e6224099-8405-45a6-8807-b10347d2574a service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0789921 Nov 11 17:17:09.822178 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-783328ca-7886-4c8d-a3d4-8e50ca3173c8 req-0b388d05-308d-44f7-8f55-9e8eb5b5c5b6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:09.823799 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-783328ca-7886-4c8d-a3d4-8e50ca3173c8 req-0b388d05-308d-44f7-8f55-9e8eb5b5c5b6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0497682 Nov 11 17:17:09.878750 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-783328ca-7886-4c8d-a3d4-8e50ca3173c8 req-6282ffe6-b98a-4973-8f42-4136a803a275 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0483530 Nov 11 17:17:10.086294 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-00efe3f2-ef4f-4ef8-adca-e86775f22c25 req-a6d3dc8c-cf0c-4b3c-8dea-cad9232a80e6 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 210 time: 0.0289352 Nov 11 17:17:10.233693 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b9cdd99-4815-44de-a73d-4a1476d96506 req-269e2be7-8511-49ba-b6e2-6afd94799b7f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:10.235302 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1b9cdd99-4815-44de-a73d-4a1476d96506 req-269e2be7-8511-49ba-b6e2-6afd94799b7f tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0569551 Nov 11 17:17:10.286605 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1b9cdd99-4815-44de-a73d-4a1476d96506 req-23fe9db5-58e4-4aa3-a0d0-f13b004a7c64 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450332 Nov 11 17:17:10.475305 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-9a3aa7e6-c1f9-4a08-a29a-41df45cffbbb tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:10.476994 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-9a3aa7e6-c1f9-4a08-a29a-41df45cffbbb tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.10 "GET /v2.0/networks?id=45e6626a-2007-490b-a445-d7c3baea689e HTTP/1.1" status: 200 len: 811 time: 0.1468742 Nov 11 17:17:10.488848 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2834085-fbf2-4026-b254-d7dfe58a70a9 req-907c1618-b71d-4e7f-ac07-9e6549b34525 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:10.490793 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a2834085-fbf2-4026-b254-d7dfe58a70a9 req-907c1618-b71d-4e7f-ac07-9e6549b34525 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 948 time: 0.0776925 Nov 11 17:17:10.575829 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a2834085-fbf2-4026-b254-d7dfe58a70a9 req-e11581f4-553a-4e96-adfc-6f83bc40a869 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0791333 Nov 11 17:17:10.585838 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-2083e275-345a-4d12-8ed5-9db27bc6fe8d tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=10bedfb35d1e481aa78e025489c1be2d HTTP/1.1" status: 200 len: 380 time: 0.0944593 Nov 11 17:17:10.601328 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-46f2d6c9-b043-4d18-aecc-b9badfde4fe4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Request body: {'port': {'device_id': '0d252f56-dd95-4edc-b002-65db4d8fc4d8', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'admin_state_up': True, 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'security_groups': ['a3fcdc84-afa7-461b-8091-b146ab222f62']}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:17:10.872383 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-46f2d6c9-b043-4d18-aecc-b9badfde4fe4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Made reservation on behalf of 10bedfb35d1e481aa78e025489c1be2d for: {'port': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:17:10.876036 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-46f2d6c9-b043-4d18-aecc-b9badfde4fe4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:11.001666 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceb7e16c-464e-49a0-9892-06d1a0c90967 req-3ae90d80-92d2-410b-afc8-0edd92e52bf8 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:11.003207 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ceb7e16c-464e-49a0-9892-06d1a0c90967 req-3ae90d80-92d2-410b-afc8-0edd92e52bf8 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0494452 Nov 11 17:17:11.013871 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-46f2d6c9-b043-4d18-aecc-b9badfde4fe4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Allocated IP 172.20.0.5 (45e6626a-2007-490b-a445-d7c3baea689e/bf78c82f-f2f3-4ef7-8052-be816dbd2df8/187c87f3-1a3e-48da-b88a-46d1ee4144ea) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:17:11.058327 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ceb7e16c-464e-49a0-9892-06d1a0c90967 req-7b8c5a43-81e9-4d68-a75e-976a20123597 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0490823 Nov 11 17:17:11.174315 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device e137bc22-ff95-4ab6-8968-d2101235153c details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:17:11.195951 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-46f2d6c9-b043-4d18-aecc-b9badfde4fe4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:11.215222 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-44c12b2c-9dfd-4338-b0f4-8f9efe6b07e1 req-333f2cff-ab89-4059-ac0b-c9b43b4440b9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 210 time: 0.0516841 Nov 11 17:17:11.287970 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port e137bc22-ff95-4ab6-8968-d2101235153c, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=e137bc22-ff95-4ab6-8968-d2101235153c,segment=NetworkSegment(6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf),segment_id=6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:17:11.299902 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': 'e137bc22-ff95-4ab6-8968-d2101235153c', 'network_id': '5cc951aa-501f-4b44-a0ad-11046541b62a', 'port_id': 'e137bc22-ff95-4ab6-8968-d2101235153c', 'mac_address': 'fa:16:3e:c1:14:70', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 526, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b1116129-689a-47aa-b946-b2cf91d8a485', 'ip_address': '192.168.233.102'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:17:11.306305 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-46f2d6c9-b043-4d18-aecc-b9badfde4fe4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:11.348633 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:11.357840 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-46f2d6c9-b043-4d18-aecc-b9badfde4fe4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Network 45e6626a-2007-490b-a445-d7c3baea689e is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:17:11.364256 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e137bc22-ff95-4ab6-8968-d2101235153c {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:17:11.365317 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-46f2d6c9-b043-4d18-aecc-b9badfde4fe4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:17:11.368614 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-46f2d6c9-b043-4d18-aecc-b9badfde4fe4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:17:11.383479 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46f2d6c9-b043-4d18-aecc-b9badfde4fe4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event updated for resources: {'Port': ['ID=187c87f3-1a3e-48da-b88a-46d1ee4144ea,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:11.391535 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port e137bc22-ff95-4ab6-8968-d2101235153c, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=e137bc22-ff95-4ab6-8968-d2101235153c,segment=NetworkSegment(6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf),segment_id=6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:17:11.458292 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55b68125-8367-4c37-b1af-c8bc7fdca4c2 req-50d6a406-6a3a-4e3b-8e36-119b74ffb9f0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:11.460069 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-55b68125-8367-4c37-b1af-c8bc7fdca4c2 req-50d6a406-6a3a-4e3b-8e36-119b74ffb9f0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0786233 Nov 11 17:17:11.465925 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-46f2d6c9-b043-4d18-aecc-b9badfde4fe4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:11.466655 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-46f2d6c9-b043-4d18-aecc-b9badfde4fe4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:11.506623 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:11.538091 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-55b68125-8367-4c37-b1af-c8bc7fdca4c2 req-230bfc1e-52e0-44ef-9c49-0586f66bf8c7 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715420 Nov 11 17:17:11.585881 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=e137bc22-ff95-4ab6-8968-d2101235153c,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:11.594133 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:11.594491 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:11.594866 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:11.595392 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:11.595859 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:11.603274 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-46f2d6c9-b043-4d18-aecc-b9badfde4fe4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0089450 Nov 11 17:17:11.609077 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:11.609077 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:11.609077 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:11.609077 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:11.609077 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:11.609077 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:11.609077 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:11.632177 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Request body: {'port': {'device_id': '0d252f56-dd95-4edc-b002-65db4d8fc4d8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:17:11.646933 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-c54f34e9-1a3b-408b-a9e3-f72a03c6468a None None] Provisioning complete for port 187c87f3-1a3e-48da-b88a-46d1ee4144ea triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:17:11.648178 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c54f34e9-1a3b-408b-a9e3-f72a03c6468a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:11.715335 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-c54f34e9-1a3b-408b-a9e3-f72a03c6468a None None] Port 187c87f3-1a3e-48da-b88a-46d1ee4144ea cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:17:11.743537 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:11.800682 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-452d6c92-75b3-4e33-b2d4-07e12c062423 req-15be9453-2d28-44e9-b6c3-136271d87745 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:11.803244 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-452d6c92-75b3-4e33-b2d4-07e12c062423 req-15be9453-2d28-44e9-b6c3-136271d87745 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 949 time: 0.1106706 Nov 11 17:17:11.819595 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['e137bc22-ff95-4ab6-8968-d2101235153c'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:17:11.949714 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-452d6c92-75b3-4e33-b2d4-07e12c062423 req-35f4c58f-56dc-4b56-a682-5378b641612f tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1306572 Nov 11 17:17:12.198618 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 187c87f3-1a3e-48da-b88a-46d1ee4144ea {{(pid=102323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:17:12.210266 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:12.251416 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.provisioning_blocks [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Transition to ACTIVE for port object 187c87f3-1a3e-48da-b88a-46d1ee4144ea will not be triggered until provisioned by entity L2. {{(pid=102323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:17:12.257528 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9148c2-5cab-47b1-a1b4-7935d437a259 req-1d9c2462-58f3-4073-b4c5-521a35bd8924 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:12.259519 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9c9148c2-5cab-47b1-a1b4-7935d437a259 req-1d9c2462-58f3-4073-b4c5-521a35bd8924 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0753329 Nov 11 17:17:12.273484 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4ee9ec5-8d35-4624-abe0-b4c12ee684bc req-64eeaac0-cbfb-4d95-b86f-fae22546aefe tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:12.275084 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b4ee9ec5-8d35-4624-abe0-b4c12ee684bc req-64eeaac0-cbfb-4d95-b86f-fae22546aefe tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0620720 Nov 11 17:17:12.309332 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:12.392434 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b4ee9ec5-8d35-4624-abe0-b4c12ee684bc req-e8c84672-56cb-4e0d-9790-596a9e8f1c72 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1094198 Nov 11 17:17:12.400140 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Pushing event updated for resources: {'Port': ['ID=187c87f3-1a3e-48da-b88a-46d1ee4144ea,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:12.410899 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-611cff6a-a677-42f0-a60b-77ca5765552e req-973d1381-97af-429c-bcbb-4d4689aab2a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:12.410899 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-611cff6a-a677-42f0-a60b-77ca5765552e req-973d1381-97af-429c-bcbb-4d4689aab2a4 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ed26d137d98846b9b45708f7e581e9b0&device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 1098 time: 0.1292188 Nov 11 17:17:12.413791 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9c9148c2-5cab-47b1-a1b4-7935d437a259 req-6480e176-1920-4761-a8b2-befad1cecfe5 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1474395 Nov 11 17:17:12.565040 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Attempting to bind port 187c87f3-1a3e-48da-b88a-46d1ee4144ea on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:17:12.565484 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Attempting to bind port 187c87f3-1a3e-48da-b88a-46d1ee4144ea by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:17:12.565745 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Attempting to bind port 187c87f3-1a3e-48da-b88a-46d1ee4144ea on network 45e6626a-2007-490b-a445-d7c3baea689e {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:17:12.572447 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Port 187c87f3-1a3e-48da-b88a-46d1ee4144ea on network 45e6626a-2007-490b-a445-d7c3baea689e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:17:12.572771 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Attempting to bind port 187c87f3-1a3e-48da-b88a-46d1ee4144ea on network 45e6626a-2007-490b-a445-d7c3baea689e {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:17:12.578831 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 16, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:17:12.579154 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Checking segment: {'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:17:12.579571 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Bound using segment: {'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:17:12.580107 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Bound port: 187c87f3-1a3e-48da-b88a-46d1ee4144ea, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'}}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:17:12.580464 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:12.583196 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-611cff6a-a677-42f0-a60b-77ca5765552e req-f18334f9-44b0-474e-be0b-ff460d37b17a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:12.584704 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-611cff6a-a677-42f0-a60b-77ca5765552e req-f18334f9-44b0-474e-be0b-ff460d37b17a service neutron] 10.222.0.10 "GET /v2.0/networks?id=983bda4c-112d-442d-b37a-387818bb1d45 HTTP/1.1" status: 200 len: 919 time: 0.1652560 Nov 11 17:17:12.592808 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cc72793-fa11-4df1-b64e-096100c5ba47 req-ad7d6655-e56b-476a-a1c3-5d7747d69a54 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:12.594385 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2cc72793-fa11-4df1-b64e-096100c5ba47 req-ad7d6655-e56b-476a-a1c3-5d7747d69a54 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 943 time: 0.0932915 Nov 11 17:17:12.639273 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-611cff6a-a677-42f0-a60b-77ca5765552e req-a4793761-c7bd-4b93-9606-cb834db19e58 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=904b538c-2fcd-42a3-bc02-26c84d4d00cb HTTP/1.1" status: 200 len: 217 time: 0.0437887 Nov 11 17:17:12.682001 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] For port 187c87f3-1a3e-48da-b88a-46d1ee4144ea, host hv-cinder-69414, cleared binding levels {{(pid=102323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:17:12.686945 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] For port 187c87f3-1a3e-48da-b88a-46d1ee4144ea, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=187c87f3-1a3e-48da-b88a-46d1ee4144ea,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:17:12.722342 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-611cff6a-a677-42f0-a60b-77ca5765552e req-e74fdd04-6722-4d9e-8146-6cdb8d90873a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:12.723735 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-611cff6a-a677-42f0-a60b-77ca5765552e req-e74fdd04-6722-4d9e-8146-6cdb8d90873a service neutron] 10.222.0.10 "GET /v2.0/subnets?id=aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4 HTTP/1.1" status: 200 len: 858 time: 0.0701175 Nov 11 17:17:12.727933 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2cc72793-fa11-4df1-b64e-096100c5ba47 req-93893e3b-5811-4a64-9c7c-ff4ddef68da3 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0913579 Nov 11 17:17:12.763978 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-611cff6a-a677-42f0-a60b-77ca5765552e req-8bf1ffcc-f254-4074-8c95-b088c0f709aa service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=983bda4c-112d-442d-b37a-387818bb1d45&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0310180 Nov 11 17:17:12.810289 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:12.852624 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:12.853303 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:12.855356 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] 10.222.0.10 "PUT /v2.0/ports/187c87f3-1a3e-48da-b88a-46d1ee4144ea HTTP/1.1" status: 200 len: 1093 time: 1.2327578 Nov 11 17:17:12.857183 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0d252f56-dd95-4edc-b002-65db4d8fc4d8', 'tag': '187c87f3-1a3e-48da-b88a-46d1ee4144ea'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:17:12.858422 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-23ca2820-7e31-4633-9f86-1a6fede645d8" -d '{"events": [{"name": "network-changed", "server_uuid": "0d252f56-dd95-4edc-b002-65db4d8fc4d8", "tag": "187c87f3-1a3e-48da-b88a-46d1ee4144ea"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:17:12.864757 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-611cff6a-a677-42f0-a60b-77ca5765552e req-0a9cde56-8087-4e6b-8d29-81e5ffaaa107 service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0931287 Nov 11 17:17:12.882014 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3c008f9-72c5-4ae2-9444-dcce5a04b71a service neutron] Pushing event updated for resources: {'Port': ['ID=187c87f3-1a3e-48da-b88a-46d1ee4144ea,revision_number=3']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:12.913851 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:17:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-91d03bfd-cde5-4832-a279-099c3d25d20b x-openstack-request-id: req-91d03bfd-cde5-4832-a279-099c3d25d20b {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:17:12.913851 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0d252f56-dd95-4edc-b002-65db4d8fc4d8", "tag": "187c87f3-1a3e-48da-b88a-46d1ee4144ea", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:17:12.914084 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-91d03bfd-cde5-4832-a279-099c3d25d20b {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:17:12.914631 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0d252f56-dd95-4edc-b002-65db4d8fc4d8', 'tag': '187c87f3-1a3e-48da-b88a-46d1ee4144ea', 'status': 'completed', 'code': 200} Nov 11 17:17:13.025063 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-611cff6a-a677-42f0-a60b-77ca5765552e req-4519e15a-3778-4a47-84b8-36e9d703c65c service neutron] 10.222.0.10 "GET /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1525235 Nov 11 17:17:13.025746 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ca2820-7e31-4633-9f86-1a6fede645d8 req-ab5bc973-6480-40a5-87f2-6df652327b65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:13.031146 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-23ca2820-7e31-4633-9f86-1a6fede645d8 req-ab5bc973-6480-40a5-87f2-6df652327b65 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 1096 time: 0.0780478 Nov 11 17:17:13.085818 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-899c789f-0ee5-4c23-97d3-e74ab7b02dc3 req-af022200-d8bc-46a8-bd45-a5d8d97d8e79 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:13.087571 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-899c789f-0ee5-4c23-97d3-e74ab7b02dc3 req-af022200-d8bc-46a8-bd45-a5d8d97d8e79 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 949 time: 0.0576739 Nov 11 17:17:13.155328 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-899c789f-0ee5-4c23-97d3-e74ab7b02dc3 req-351ec836-b9b4-4d82-8986-7c14fc7a7e8b tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0598769 Nov 11 17:17:13.195151 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ca2820-7e31-4633-9f86-1a6fede645d8 req-35f1b869-112f-4ca5-8422-05513c31911f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:13.195832 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device e137bc22-ff95-4ab6-8968-d2101235153c up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:17:13.196748 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-23ca2820-7e31-4633-9f86-1a6fede645d8 req-35f1b869-112f-4ca5-8422-05513c31911f service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=10bedfb35d1e481aa78e025489c1be2d&shared=False HTTP/1.1" status: 200 len: 912 time: 0.1529956 Nov 11 17:17:13.244136 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd414eb-78dc-44be-b193-24bb4e63af70 req-b431f37d-c016-4e76-87ec-8001a5dc89b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:13.246248 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1bd414eb-78dc-44be-b193-24bb4e63af70 req-b431f37d-c016-4e76-87ec-8001a5dc89b4 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=3a6e5bdc578b460ab28a883efa598f95&device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 1097 time: 0.0670483 Nov 11 17:17:13.328829 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ca2820-7e31-4633-9f86-1a6fede645d8 req-8fb1656b-e076-49de-92ac-ace39b2ae10a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:13.330555 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-23ca2820-7e31-4633-9f86-1a6fede645d8 req-8fb1656b-e076-49de-92ac-ace39b2ae10a service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1240947 Nov 11 17:17:13.353103 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port e137bc22-ff95-4ab6-8968-d2101235153c completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:17:13.359527 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port e137bc22-ff95-4ab6-8968-d2101235153c triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:17:13.360329 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:13.439071 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-1dfe510e-b0d2-4a96-8263-13a0763c738c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:13.440570 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-1dfe510e-b0d2-4a96-8263-13a0763c738c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 1096 time: 0.0591593 Nov 11 17:17:13.468965 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd414eb-78dc-44be-b193-24bb4e63af70 req-d4c018c0-25c5-4ca9-8967-bf757e4623b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:13.470954 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1bd414eb-78dc-44be-b193-24bb4e63af70 req-d4c018c0-25c5-4ca9-8967-bf757e4623b3 service neutron] 10.222.0.10 "GET /v2.0/networks?id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f HTTP/1.1" status: 200 len: 917 time: 0.2002170 Nov 11 17:17:13.473029 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:13.500332 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-de88cf85-8afa-47ab-8bae-52d8bc78958e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=187c87f3-1a3e-48da-b88a-46d1ee4144ea HTTP/1.1" status: 200 len: 217 time: 0.0480528 Nov 11 17:17:13.514816 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '012d9d04-cb70-46f9-869f-49b2eaefd62e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e137bc22-ff95-4ab6-8968-d2101235153c'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:17:13.521937 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-addea035-7c6e-4477-81d2-ae6420da26ab" -d '{"events": [{"server_uuid": "012d9d04-cb70-46f9-869f-49b2eaefd62e", "name": "network-vif-plugged", "status": "completed", "tag": "e137bc22-ff95-4ab6-8968-d2101235153c"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:17:13.546205 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port e137bc22-ff95-4ab6-8968-d2101235153c, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=e137bc22-ff95-4ab6-8968-d2101235153c,segment=NetworkSegment(6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf),segment_id=6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:17:13.624800 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b9163d-4884-48cc-8c84-c4e574f09cef req-2e547a12-ea98-42e6-95d1-d37f5a124b22 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:13.631258 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-57b9163d-4884-48cc-8c84-c4e574f09cef req-2e547a12-ea98-42e6-95d1-d37f5a124b22 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.1590531 Nov 11 17:17:13.646754 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-eec02629-dff6-4323-971c-5bd5dbffd0bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:13.647794 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1bd414eb-78dc-44be-b193-24bb4e63af70 req-b959eac8-d9c6-45f0-92d3-abb730670495 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5de5065e-0ad8-4180-bd18-4e9927716a88 HTTP/1.1" status: 200 len: 1000 time: 0.1638179 Nov 11 17:17:13.648218 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-eec02629-dff6-4323-971c-5bd5dbffd0bb service neutron] 10.222.0.10 "GET /v2.0/subnets?id=bf78c82f-f2f3-4ef7-8052-be816dbd2df8 HTTP/1.1" status: 200 len: 850 time: 0.1285951 Nov 11 17:17:13.655401 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:13.706879 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e7b7f0e-dc48-48ea-9bf5-48d7766ea5f3 req-c5ce699f-6cb0-4bad-9e6d-0500e423bb73 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:13.708602 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5e7b7f0e-dc48-48ea-9bf5-48d7766ea5f3 req-c5ce699f-6cb0-4bad-9e6d-0500e423bb73 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.1212373 Nov 11 17:17:13.746642 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-57b9163d-4884-48cc-8c84-c4e574f09cef req-57760f19-2d61-4845-91c6-f53054e2d84b tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1096821 Nov 11 17:17:13.749397 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-ef4efebc-555c-4431-8487-a5afb1c6feb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:13.752255 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-ef4efebc-555c-4431-8487-a5afb1c6feb5 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=45e6626a-2007-490b-a445-d7c3baea689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0811539 Nov 11 17:17:13.782982 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd414eb-78dc-44be-b193-24bb4e63af70 req-d900f3f2-80ed-4087-b0b6-7c2ec571670b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:13.786807 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1bd414eb-78dc-44be-b193-24bb4e63af70 req-d900f3f2-80ed-4087-b0b6-7c2ec571670b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=1a4b11d7-2160-49c3-be78-265f0700c580 HTTP/1.1" status: 200 len: 855 time: 0.1087673 Nov 11 17:17:13.809750 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5e7b7f0e-dc48-48ea-9bf5-48d7766ea5f3 req-ee2a7706-0500-43a8-848d-bf383ceccaf5 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0932627 Nov 11 17:17:13.864722 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:17:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-40777478-2c6f-48ea-8d50-89e4f3371311 x-openstack-request-id: req-40777478-2c6f-48ea-8d50-89e4f3371311 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:17:13.865421 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "012d9d04-cb70-46f9-869f-49b2eaefd62e", "name": "network-vif-plugged", "status": "completed", "tag": "e137bc22-ff95-4ab6-8968-d2101235153c", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:17:13.865687 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-40777478-2c6f-48ea-8d50-89e4f3371311 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:17:13.866954 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '012d9d04-cb70-46f9-869f-49b2eaefd62e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e137bc22-ff95-4ab6-8968-d2101235153c', 'code': 200} Nov 11 17:17:13.887782 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd414eb-78dc-44be-b193-24bb4e63af70 req-891acd78-6cae-4a7c-b8de-ad40db827517 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:13.888977 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=e137bc22-ff95-4ab6-8968-d2101235153c,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:13.889431 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1bd414eb-78dc-44be-b193-24bb4e63af70 req-891acd78-6cae-4a7c-b8de-ad40db827517 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0869594 Nov 11 17:17:13.894423 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-1c6964ba-5c7e-4d09-9fa0-8ae963759aed service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1322954 Nov 11 17:17:14.008122 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1bd414eb-78dc-44be-b193-24bb4e63af70 req-0b5e8f37-95cf-45b7-8378-b85ce6aad99a service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1027122 Nov 11 17:17:14.021391 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37bb018-286e-4b47-a413-c9e02e7424a5 req-c5c1fc25-6875-42de-9f3c-23de635ea03f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:14.022967 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c37bb018-286e-4b47-a413-c9e02e7424a5 req-c5c1fc25-6875-42de-9f3c-23de635ea03f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 943 time: 0.1151674 Nov 11 17:17:14.062102 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4466fc6d-9d5f-4d43-8d88-021c463532fc req-9fc4c230-7e32-4f0d-af0f-ab73d4dc7fa4 service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1521547 Nov 11 17:17:14.095643 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c37bb018-286e-4b47-a413-c9e02e7424a5 req-e2047be9-659b-4e1e-ac1c-c9b95a3fb048 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0634229 Nov 11 17:17:14.112007 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1bd414eb-78dc-44be-b193-24bb4e63af70 req-365693ff-74bb-4473-9312-c50465c5fab7 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0956929 Nov 11 17:17:14.203541 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584113f0-2a69-4712-8c41-7ec2dbebe145 req-5280dac7-c304-4dc8-9ab2-a4988edbc819 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:14.205377 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-584113f0-2a69-4712-8c41-7ec2dbebe145 req-5280dac7-c304-4dc8-9ab2-a4988edbc819 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 1103 time: 0.0474041 Nov 11 17:17:14.277712 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-584113f0-2a69-4712-8c41-7ec2dbebe145 req-423e23ce-63f9-450b-b903-be3ec174219a service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638549 Nov 11 17:17:14.297943 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377ea3b5-128c-43f9-a8b6-0bd8bddfb316 req-f42cbf9d-33fe-4a3e-b1af-788a9a214ee5 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:14.299430 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-377ea3b5-128c-43f9-a8b6-0bd8bddfb316 req-f42cbf9d-33fe-4a3e-b1af-788a9a214ee5 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 950 time: 0.0604227 Nov 11 17:17:14.360347 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-377ea3b5-128c-43f9-a8b6-0bd8bddfb316 req-ccccc6f6-da5f-4d82-9f2e-45c2fb321f7e tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547838 Nov 11 17:17:14.882143 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e582730-8f2d-409c-967c-7459a8c4cc71 req-6c61483d-469d-40d0-b030-6d8fb6f2eae7 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:14.883793 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4e582730-8f2d-409c-967c-7459a8c4cc71 req-6c61483d-469d-40d0-b030-6d8fb6f2eae7 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0558126 Nov 11 17:17:14.937330 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4e582730-8f2d-409c-967c-7459a8c4cc71 req-69899cde-42e3-4af2-b681-dbed16923a79 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467830 Nov 11 17:17:14.966980 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-901350f8-e67b-4a32-92a0-c044d52ea198 req-be96e488-c2c8-4134-8aef-3bd5a941c9a7 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:14.968783 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-901350f8-e67b-4a32-92a0-c044d52ea198 req-be96e488-c2c8-4134-8aef-3bd5a941c9a7 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0611765 Nov 11 17:17:15.017106 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-901350f8-e67b-4a32-92a0-c044d52ea198 req-b2b79a51-fed4-42f0-a8a2-034a26688750 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421925 Nov 11 17:17:15.227039 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b92a70b2-bc28-4be6-ab40-77048dc15912 req-b4b012bd-64f6-472a-a922-37f7880ea4da tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:15.228644 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b92a70b2-bc28-4be6-ab40-77048dc15912 req-b4b012bd-64f6-472a-a922-37f7880ea4da tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 943 time: 0.0540125 Nov 11 17:17:15.282341 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b92a70b2-bc28-4be6-ab40-77048dc15912 req-53508541-ba8a-43f3-8fc7-e4bb644bc265 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476255 Nov 11 17:17:15.485637 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92798d82-7d99-433a-a5c3-9718b799ca29 req-eb10915e-997b-40c7-8a9b-677be84adfcf tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:15.487157 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-92798d82-7d99-433a-a5c3-9718b799ca29 req-eb10915e-997b-40c7-8a9b-677be84adfcf tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 950 time: 0.0496445 Nov 11 17:17:15.536860 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-92798d82-7d99-433a-a5c3-9718b799ca29 req-d4169070-7c46-40d6-a450-2b8ae282d72c tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435655 Nov 11 17:17:16.075444 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bac079a8-f5d4-4bb7-a922-7f7a0565f75a req-536daac1-5512-4b44-8f1c-d02cf33ffb14 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:16.083482 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-bac079a8-f5d4-4bb7-a922-7f7a0565f75a req-536daac1-5512-4b44-8f1c-d02cf33ffb14 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0664716 Nov 11 17:17:16.149451 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-bac079a8-f5d4-4bb7-a922-7f7a0565f75a req-e01666dd-4745-49f8-8228-0e03176f96c7 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584633 Nov 11 17:17:16.170827 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ad6e12b-2187-46e4-9f4c-7b69d108c1c7 req-9e31d458-807b-4bc0-bd6e-49c8a9b6356c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:16.172406 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7ad6e12b-2187-46e4-9f4c-7b69d108c1c7 req-9e31d458-807b-4bc0-bd6e-49c8a9b6356c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0664611 Nov 11 17:17:16.227241 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7ad6e12b-2187-46e4-9f4c-7b69d108c1c7 req-bd5b1b49-dc4f-490e-b5f5-0950733f8288 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0481346 Nov 11 17:17:16.407024 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de441398-5e1b-4bd6-8338-eb94fb546f6f req-a762289c-697a-420c-9bbe-f3892a3dabfd tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:16.409092 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-de441398-5e1b-4bd6-8338-eb94fb546f6f req-a762289c-697a-420c-9bbe-f3892a3dabfd tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 943 time: 0.0590250 Nov 11 17:17:16.464704 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-de441398-5e1b-4bd6-8338-eb94fb546f6f req-96195c9e-5478-42cd-bb60-9a1fbf0ec854 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0498703 Nov 11 17:17:16.655964 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b346188-5680-4644-bf01-1e93c52c7d3c req-af1b1334-bf69-41a0-97b6-ce7984c5f2e2 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:16.657548 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8b346188-5680-4644-bf01-1e93c52c7d3c req-af1b1334-bf69-41a0-97b6-ce7984c5f2e2 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 950 time: 0.0516770 Nov 11 17:17:16.712030 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8b346188-5680-4644-bf01-1e93c52c7d3c req-66951098-02ee-4fab-81fc-1f920a66c704 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480397 Nov 11 17:17:16.820802 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:17.179715 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c964b6e-43b9-4891-ba2c-ab8cafdd75b9 req-cf4f71e2-a42e-4901-bad2-416a5c68865c tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:17.181348 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3c964b6e-43b9-4891-ba2c-ab8cafdd75b9 req-cf4f71e2-a42e-4901-bad2-416a5c68865c tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 950 time: 0.0519724 Nov 11 17:17:17.221734 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 5de5065e-0ad8-4180-bd18-4e9927716a88 details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:17:17.233525 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3c964b6e-43b9-4891-ba2c-ab8cafdd75b9 req-58218701-6e1a-4e3b-8a1a-f1f6b37cdf6c tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442615 Nov 11 17:17:17.325605 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 5de5065e-0ad8-4180-bd18-4e9927716a88, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5de5065e-0ad8-4180-bd18-4e9927716a88,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:17:17.339489 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '5de5065e-0ad8-4180-bd18-4e9927716a88', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'port_id': '5de5065e-0ad8-4180-bd18-4e9927716a88', 'mac_address': 'fa:16:3e:0f:ef:ce', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 538, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:17:17.356704 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82868c4e-4e2d-46f0-9fb0-331052903a00 req-fb4c3089-990a-46da-bfb5-2121ed37d214 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:17.358370 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-82868c4e-4e2d-46f0-9fb0-331052903a00 req-fb4c3089-990a-46da-bfb5-2121ed37d214 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 944 time: 0.0559943 Nov 11 17:17:17.383195 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:17.397641 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5de5065e-0ad8-4180-bd18-4e9927716a88 {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:17:17.412596 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-82868c4e-4e2d-46f0-9fb0-331052903a00 req-4b14f0c7-8746-4891-9b2e-4be7b98ee85d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0479040 Nov 11 17:17:17.419730 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 5de5065e-0ad8-4180-bd18-4e9927716a88, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5de5065e-0ad8-4180-bd18-4e9927716a88,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:17:17.477165 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:17.533163 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=5de5065e-0ad8-4180-bd18-4e9927716a88,revision_number=9']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:17.588979 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bfbdda8-55f3-445c-9d21-9e1479966f9a req-955d806f-5dda-4c06-80b4-edeea65e3262 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:17.590627 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3bfbdda8-55f3-445c-9d21-9e1479966f9a req-955d806f-5dda-4c06-80b4-edeea65e3262 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 943 time: 0.0531015 Nov 11 17:17:17.642182 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3bfbdda8-55f3-445c-9d21-9e1479966f9a req-aa53e0c6-c74f-49c6-8197-ab791c16e3a1 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456536 Nov 11 17:17:17.862007 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['5de5065e-0ad8-4180-bd18-4e9927716a88'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:17:18.351189 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42bded2b-0fda-4b03-bdd1-b0edbcf4874f req-ac21fd90-ce51-4348-9539-d47a17afe2fc tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:18.352886 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-42bded2b-0fda-4b03-bdd1-b0edbcf4874f req-ac21fd90-ce51-4348-9539-d47a17afe2fc tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 950 time: 0.0498130 Nov 11 17:17:18.402471 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-42bded2b-0fda-4b03-bdd1-b0edbcf4874f req-9fd3f00b-d6e8-4ea7-8aa8-ffe0585199b6 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437136 Nov 11 17:17:18.590177 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9b7f8d5-4bf4-49da-abf1-517e72d078ad req-ebc5c301-2bc5-418d-bdce-d041a9edd0af tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:18.591715 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f9b7f8d5-4bf4-49da-abf1-517e72d078ad req-ebc5c301-2bc5-418d-bdce-d041a9edd0af tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 945 time: 0.0540888 Nov 11 17:17:18.639263 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f9b7f8d5-4bf4-49da-abf1-517e72d078ad req-3822e29f-1a1d-425f-865a-e06bdb813196 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417008 Nov 11 17:17:18.771698 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5fde94a-2727-4ba0-8291-04bc88b8a9fa req-de9e7585-88fd-42f5-b9cb-efc69deeb642 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:18.773287 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f5fde94a-2727-4ba0-8291-04bc88b8a9fa req-de9e7585-88fd-42f5-b9cb-efc69deeb642 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 943 time: 0.0566008 Nov 11 17:17:18.830082 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f5fde94a-2727-4ba0-8291-04bc88b8a9fa req-e1431534-becf-4e9d-833f-7c4b7df09325 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501490 Nov 11 17:17:19.087387 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6976aeb-36e9-40a0-9b4b-c7854545d978 req-0c44246d-a889-4130-8452-1173530ad782 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:19.089375 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b6976aeb-36e9-40a0-9b4b-c7854545d978 req-0c44246d-a889-4130-8452-1173530ad782 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.10 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 950 time: 0.0488782 Nov 11 17:17:19.199020 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-b6976aeb-36e9-40a0-9b4b-c7854545d978 req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Deleting port e137bc22-ff95-4ab6-8968-d2101235153c {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:17:19.199481 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-b6976aeb-36e9-40a0-9b4b-c7854545d978 req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:19.240444 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 5de5065e-0ad8-4180-bd18-4e9927716a88 up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:17:19.294221 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 5de5065e-0ad8-4180-bd18-4e9927716a88 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:17:19.294783 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:19.305225 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-b6976aeb-36e9-40a0-9b4b-c7854545d978 req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] For port e137bc22-ff95-4ab6-8968-d2101235153c, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=e137bc22-ff95-4ab6-8968-d2101235153c,segment=NetworkSegment(6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf),segment_id=6ae5bf1c-bfa9-48aa-b3f2-4f9a9a6ad6bf)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:17:19.305606 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-b6976aeb-36e9-40a0-9b4b-c7854545d978 req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:19.319057 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-b6976aeb-36e9-40a0-9b4b-c7854545d978 req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Calling delete_port for e137bc22-ff95-4ab6-8968-d2101235153c owned by compute:nova {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:17:19.384415 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:19.409780 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '51c0e58c-1427-425f-ba26-73999c61ac11', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5de5065e-0ad8-4180-bd18-4e9927716a88'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:17:19.414578 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9712903c-a8df-4643-8a72-0f4085b48f38" -d '{"events": [{"server_uuid": "51c0e58c-1427-425f-ba26-73999c61ac11", "name": "network-vif-plugged", "status": "completed", "tag": "5de5065e-0ad8-4180-bd18-4e9927716a88"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:17:19.437511 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 5de5065e-0ad8-4180-bd18-4e9927716a88, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5de5065e-0ad8-4180-bd18-4e9927716a88,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:17:19.453680 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:17:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-63ef3ab1-baf7-4a6d-9f1f-71189f33cf73 x-openstack-request-id: req-63ef3ab1-baf7-4a6d-9f1f-71189f33cf73 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:17:19.453972 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "51c0e58c-1427-425f-ba26-73999c61ac11", "name": "network-vif-plugged", "status": "completed", "tag": "5de5065e-0ad8-4180-bd18-4e9927716a88", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:17:19.454219 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-63ef3ab1-baf7-4a6d-9f1f-71189f33cf73 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:17:19.454651 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '51c0e58c-1427-425f-ba26-73999c61ac11', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5de5065e-0ad8-4180-bd18-4e9927716a88', 'code': 200} Nov 11 17:17:19.500795 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:19.501604 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device e137bc22-ff95-4ab6-8968-d2101235153c no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:17:19.528690 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f96277f-7aa8-4d39-8976-5fc50350218b req-60e5a796-ff9f-428b-a07a-b5bff150bcac tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:19.530203 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2f96277f-7aa8-4d39-8976-5fc50350218b req-60e5a796-ff9f-428b-a07a-b5bff150bcac tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 950 time: 0.0493910 Nov 11 17:17:19.531397 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-b6976aeb-36e9-40a0-9b4b-c7854545d978 req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:19.570294 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Pushing event deleted for resources: {'Port': ['ID=e137bc22-ff95-4ab6-8968-d2101235153c,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:19.581398 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No active binding found for port e137bc22-ff95-4ab6-8968-d2101235153c {{(pid=102325) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Nov 11 17:17:19.581847 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device e137bc22-ff95-4ab6-8968-d2101235153c not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:17:19.583326 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=5de5065e-0ad8-4180-bd18-4e9927716a88,revision_number=10']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:19.592456 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:19.592939 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:19.593239 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:19.593443 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:19.593773 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:19.594130 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:19.594424 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:19.594778 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:19.595102 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:19.598156 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:19.598498 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:19.598871 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:19.642416 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-b6976aeb-36e9-40a0-9b4b-c7854545d978 req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] No DVR routers for this DVR port e137bc22-ff95-4ab6-8968-d2101235153c on host hv-cinder-69414 {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:17:19.652041 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-b6976aeb-36e9-40a0-9b4b-c7854545d978 req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:19.655344 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b6976aeb-36e9-40a0-9b4b-c7854545d978 req-338d03d7-cf83-4b28-a671-baaf707bdab3 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.10 "DELETE /v2.0/ports/e137bc22-ff95-4ab6-8968-d2101235153c HTTP/1.1" status: 204 len: 173 time: 0.5595012 Nov 11 17:17:19.655891 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '012d9d04-cb70-46f9-869f-49b2eaefd62e', 'name': 'network-vif-deleted', 'tag': 'e137bc22-ff95-4ab6-8968-d2101235153c'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:17:19.658017 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c04f23ff-c076-4802-a95f-c6e5ea192265" -d '{"events": [{"server_uuid": "012d9d04-cb70-46f9-869f-49b2eaefd62e", "name": "network-vif-deleted", "tag": "e137bc22-ff95-4ab6-8968-d2101235153c"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:17:19.673779 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2f96277f-7aa8-4d39-8976-5fc50350218b req-6b8ab782-9657-4a2a-a2ed-f06e52221630 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/security-groups?id=16fa915a-0ce2-4da9-888b-efc8cf40e573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1315124 Nov 11 17:17:19.703513 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:17:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c3c72c8f-05cc-4909-aa63-4c0f588a9d8d x-openstack-request-id: req-c3c72c8f-05cc-4909-aa63-4c0f588a9d8d {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:17:19.703879 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "012d9d04-cb70-46f9-869f-49b2eaefd62e", "name": "network-vif-deleted", "tag": "e137bc22-ff95-4ab6-8968-d2101235153c", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:17:19.704327 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-c3c72c8f-05cc-4909-aa63-4c0f588a9d8d {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:17:19.705027 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '012d9d04-cb70-46f9-869f-49b2eaefd62e', 'name': 'network-vif-deleted', 'tag': 'e137bc22-ff95-4ab6-8968-d2101235153c', 'status': 'completed', 'code': 200} Nov 11 17:17:19.808775 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d982608-5033-4911-be50-b02a032d3151 req-896a0cb3-5ecf-4313-aecc-ab76a61acef7 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:19.810352 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2d982608-5033-4911-be50-b02a032d3151 req-896a0cb3-5ecf-4313-aecc-ab76a61acef7 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 947 time: 0.0674233 Nov 11 17:17:19.877847 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2d982608-5033-4911-be50-b02a032d3151 req-e635aa99-9baf-4fb6-a493-d9237e97240d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0604255 Nov 11 17:17:19.992361 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c131c78-3ff2-43af-b994-5bf00b929e7f req-a2e55742-86f6-4ded-8603-109346f05c4b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:19.994110 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4c131c78-3ff2-43af-b994-5bf00b929e7f req-a2e55742-86f6-4ded-8603-109346f05c4b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 943 time: 0.0555613 Nov 11 17:17:20.077549 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4c131c78-3ff2-43af-b994-5bf00b929e7f req-00f7db08-6109-4b13-844e-d29ba9450439 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0765648 Nov 11 17:17:20.159207 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cef204dd-9f86-4dc9-ae49-cd94fda814a4 req-bf77a65f-09b6-4425-aef6-e36a2efd05df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:20.161637 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cef204dd-9f86-4dc9-ae49-cd94fda814a4 req-bf77a65f-09b6-4425-aef6-e36a2efd05df service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 1100 time: 0.0502458 Nov 11 17:17:20.224354 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cef204dd-9f86-4dc9-ae49-cd94fda814a4 req-05a6d411-af9f-4795-ac18-4358db83994f service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0546551 Nov 11 17:17:20.790428 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7d4287c1-ff45-456f-afb8-acd7d8278a0f req-e3b73e69-c977-4dfe-891a-db6b3224e8f8 tempest-VolumesNegativeTest-1813313914 tempest-VolumesNegativeTest-1813313914-project] 10.222.0.16 "GET /v2.0/ports?device_id=012d9d04-cb70-46f9-869f-49b2eaefd62e HTTP/1.1" status: 200 len: 210 time: 0.0279312 Nov 11 17:17:21.029659 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b0daf7e-f484-4e96-beab-fd47e1b80ac6 req-e5dd0f3a-868f-41be-bd8b-d0384299ae3c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:21.031205 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3b0daf7e-f484-4e96-beab-fd47e1b80ac6 req-e5dd0f3a-868f-41be-bd8b-d0384299ae3c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 947 time: 0.0655115 Nov 11 17:17:21.086972 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3b0daf7e-f484-4e96-beab-fd47e1b80ac6 req-3a41ba0e-2a4a-4496-9c24-3c15dd338fd4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0479703 Nov 11 17:17:21.226197 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76162a1c-926a-45c9-84ff-b54d6275bf3e req-474543d8-f94b-4a99-a276-599d0d1be179 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:21.228051 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-76162a1c-926a-45c9-84ff-b54d6275bf3e req-474543d8-f94b-4a99-a276-599d0d1be179 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 943 time: 0.0559468 Nov 11 17:17:21.289209 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-76162a1c-926a-45c9-84ff-b54d6275bf3e req-5d52986a-382a-4e81-9e5c-6aba9ef368d4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0541484 Nov 11 17:17:22.235663 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d706b9c-e872-40d7-aa4a-7b77135b6a53 req-ba9d4ecf-8635-4916-85a3-83440ab6b00b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:22.237164 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7d706b9c-e872-40d7-aa4a-7b77135b6a53 req-ba9d4ecf-8635-4916-85a3-83440ab6b00b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 947 time: 0.0704153 Nov 11 17:17:22.296680 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7d706b9c-e872-40d7-aa4a-7b77135b6a53 req-3426564d-e8bb-4ddc-9dc0-dad9a630445e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0492034 Nov 11 17:17:22.418124 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ab90831-fc83-49e4-843c-6e11aa984bda req-39bfa140-1da5-49b5-83d2-47189446e0ed tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:22.419686 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4ab90831-fc83-49e4-843c-6e11aa984bda req-39bfa140-1da5-49b5-83d2-47189446e0ed tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 943 time: 0.0497222 Nov 11 17:17:22.468441 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4ab90831-fc83-49e4-843c-6e11aa984bda req-51961f7c-4903-40e1-953b-61c9fd586cec tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426002 Nov 11 17:17:23.291966 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 187c87f3-1a3e-48da-b88a-46d1ee4144ea details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:17:23.394467 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 187c87f3-1a3e-48da-b88a-46d1ee4144ea, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=187c87f3-1a3e-48da-b88a-46d1ee4144ea,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:17:23.408648 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '187c87f3-1a3e-48da-b88a-46d1ee4144ea', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'port_id': '187c87f3-1a3e-48da-b88a-46d1ee4144ea', 'mac_address': 'fa:16:3e:be:39:c3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 505, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:17:23.429364 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc560d2-acb3-4535-98e1-b98522f0041a req-4ffa7892-a1c1-4118-abc1-10edd0c70ad4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:23.437599 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-bdc560d2-acb3-4535-98e1-b98522f0041a req-4ffa7892-a1c1-4118-abc1-10edd0c70ad4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 947 time: 0.0645723 Nov 11 17:17:23.455905 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:23.470465 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 187c87f3-1a3e-48da-b88a-46d1ee4144ea {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:17:23.487836 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-bdc560d2-acb3-4535-98e1-b98522f0041a req-5ffab4a7-77aa-4909-87a8-c69d1475a47d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0492775 Nov 11 17:17:23.493365 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 187c87f3-1a3e-48da-b88a-46d1ee4144ea, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=187c87f3-1a3e-48da-b88a-46d1ee4144ea,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:17:23.569372 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:23.601795 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fbdc59e-47e9-4292-bb19-82d6b898ec59 req-ed292a9a-d459-4e46-829a-cd17444897e9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:23.603442 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8fbdc59e-47e9-4292-bb19-82d6b898ec59 req-ed292a9a-d459-4e46-829a-cd17444897e9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 943 time: 0.0581291 Nov 11 17:17:23.627273 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=187c87f3-1a3e-48da-b88a-46d1ee4144ea,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:23.659804 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8fbdc59e-47e9-4292-bb19-82d6b898ec59 req-a6bacc31-fcc4-476d-bfde-0d4cab3a0aa8 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437207 Nov 11 17:17:24.627255 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b6527e3-a695-4ced-8ea1-fcbf52b8a3e3 req-3419d449-c856-4d8c-9001-fcf87c357763 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:24.628699 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1b6527e3-a695-4ced-8ea1-fcbf52b8a3e3 req-3419d449-c856-4d8c-9001-fcf87c357763 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 947 time: 0.0525973 Nov 11 17:17:24.691423 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1b6527e3-a695-4ced-8ea1-fcbf52b8a3e3 req-61bcf9d4-4b47-433d-b156-5c1b14dbacdb tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0563860 Nov 11 17:17:24.796502 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90bedc89-c6ba-480c-b5ee-8671f3459c74 req-ce5ff282-5bdc-4998-81f5-f61097eae2ef tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:24.798215 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-90bedc89-c6ba-480c-b5ee-8671f3459c74 req-ce5ff282-5bdc-4998-81f5-f61097eae2ef tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 944 time: 0.0564332 Nov 11 17:17:24.851625 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-90bedc89-c6ba-480c-b5ee-8671f3459c74 req-fba18d75-bd35-4c97-b4b4-2d1c535963f1 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463653 Nov 11 17:17:25.810721 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-880ea108-2ec1-4531-96a3-27552663974c req-bdcd68fe-d89b-493c-b2ba-a743a60ce724 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:25.812274 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-880ea108-2ec1-4531-96a3-27552663974c req-bdcd68fe-d89b-493c-b2ba-a743a60ce724 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 947 time: 0.0498533 Nov 11 17:17:25.867568 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-880ea108-2ec1-4531-96a3-27552663974c req-5b63617d-9a06-494a-8e32-f98325c9a86a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0494046 Nov 11 17:17:25.966339 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfdae093-c4ca-486d-a4f3-5f48f4dd2611 req-3a97ce80-c137-49a3-ae7b-5746210434e7 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:25.967927 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bfdae093-c4ca-486d-a4f3-5f48f4dd2611 req-3a97ce80-c137-49a3-ae7b-5746210434e7 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 944 time: 0.0499315 Nov 11 17:17:26.018026 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bfdae093-c4ca-486d-a4f3-5f48f4dd2611 req-d3de51ef-b445-4a66-819a-e64d9d833842 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443423 Nov 11 17:17:26.988895 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b062ea0-dcf3-4310-9df4-7aabe0e07354 req-32ab7a5c-67bd-42e4-8fa5-f3a6457268dd tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:26.990408 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1b062ea0-dcf3-4310-9df4-7aabe0e07354 req-32ab7a5c-67bd-42e4-8fa5-f3a6457268dd tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 947 time: 0.0484250 Nov 11 17:17:27.045813 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1b062ea0-dcf3-4310-9df4-7aabe0e07354 req-a9518690-7f9a-4bc5-a3ae-ebb694661b43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0486372 Nov 11 17:17:27.133298 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d00a37f9-b10b-4b5a-bb09-b31b94843b78 req-4c641abc-dd0c-457d-b39c-0e6e11cd736f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:27.134697 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d00a37f9-b10b-4b5a-bb09-b31b94843b78 req-4c641abc-dd0c-457d-b39c-0e6e11cd736f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 944 time: 0.0485125 Nov 11 17:17:27.170349 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['187c87f3-1a3e-48da-b88a-46d1ee4144ea'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:17:27.188806 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d00a37f9-b10b-4b5a-bb09-b31b94843b78 req-cd6486cf-a405-49ab-a41b-50e5678576bd tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475788 Nov 11 17:17:28.195343 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee543265-7235-454a-ad86-41b29a72f0d8 req-d1342344-9fd4-409c-b755-dd4b0ede5c70 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:28.196866 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ee543265-7235-454a-ad86-41b29a72f0d8 req-d1342344-9fd4-409c-b755-dd4b0ede5c70 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 947 time: 0.0620670 Nov 11 17:17:28.246387 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ee543265-7235-454a-ad86-41b29a72f0d8 req-0643921a-ae27-4ff0-9ef5-5ac36ce8e799 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434220 Nov 11 17:17:28.314359 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c96f41c5-de4b-4eaa-bd7b-0601daef790e req-aa78f733-a17b-475c-8033-7cdbe10da4e4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:28.315874 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c96f41c5-de4b-4eaa-bd7b-0601daef790e req-aa78f733-a17b-475c-8033-7cdbe10da4e4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 944 time: 0.0494361 Nov 11 17:17:28.368286 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c96f41c5-de4b-4eaa-bd7b-0601daef790e req-357e17a5-81d7-49b3-9288-de1378ceb2e3 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462399 Nov 11 17:17:28.788045 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 187c87f3-1a3e-48da-b88a-46d1ee4144ea up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:17:28.945665 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port 187c87f3-1a3e-48da-b88a-46d1ee4144ea completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:17:28.950582 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 187c87f3-1a3e-48da-b88a-46d1ee4144ea triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:17:28.950821 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:29.038125 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:29.061695 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0d252f56-dd95-4edc-b002-65db4d8fc4d8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '187c87f3-1a3e-48da-b88a-46d1ee4144ea'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:17:29.064112 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7b8b658f-8bcd-4f41-bea6-263754525f60" -d '{"events": [{"server_uuid": "0d252f56-dd95-4edc-b002-65db4d8fc4d8", "name": "network-vif-plugged", "status": "completed", "tag": "187c87f3-1a3e-48da-b88a-46d1ee4144ea"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:17:29.078334 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 187c87f3-1a3e-48da-b88a-46d1ee4144ea, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=187c87f3-1a3e-48da-b88a-46d1ee4144ea,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:17:29.105589 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:17:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a27cda15-7fdf-4676-a820-3788d5f2f578 x-openstack-request-id: req-a27cda15-7fdf-4676-a820-3788d5f2f578 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:17:29.106023 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0d252f56-dd95-4edc-b002-65db4d8fc4d8", "name": "network-vif-plugged", "status": "completed", "tag": "187c87f3-1a3e-48da-b88a-46d1ee4144ea", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:17:29.106333 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-a27cda15-7fdf-4676-a820-3788d5f2f578 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:17:29.106818 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0d252f56-dd95-4edc-b002-65db4d8fc4d8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '187c87f3-1a3e-48da-b88a-46d1ee4144ea', 'code': 200} Nov 11 17:17:29.125271 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 33578) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:29.167855 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:29.221044 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=187c87f3-1a3e-48da-b88a-46d1ee4144ea,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:29.263502 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-1a8dab94-20bd-43ec-97ae-96571e5d18ab admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=20af76921cde4b01b02a3b8aef4f7e37&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1370873 Nov 11 17:17:29.266022 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 33582) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:29.317868 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d3bcbf44-8275-410b-a891-b4b13f9e5bff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:29.341010 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d3bcbf44-8275-410b-a891-b4b13f9e5bff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:29.418590 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4895bf18-595b-4e10-900b-0b834f1cdd24 req-9e86aec2-72e1-4ed5-915e-7162815e854c tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:29.420230 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4895bf18-595b-4e10-900b-0b834f1cdd24 req-9e86aec2-72e1-4ed5-915e-7162815e854c tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0815094 Nov 11 17:17:29.512612 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4895bf18-595b-4e10-900b-0b834f1cdd24 req-9e58a953-37b1-4e2a-8b87-221fd630a4f9 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0765953 Nov 11 17:17:29.515729 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d3bcbf44-8275-410b-a891-b4b13f9e5bff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:29.516540 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b89dc6c-b538-4628-bbad-a9ddbda607f4 req-94650462-3dbc-4407-9152-dcd23c1dd05c tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:29.518893 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2b89dc6c-b538-4628-bbad-a9ddbda607f4 req-94650462-3dbc-4407-9152-dcd23c1dd05c tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 945 time: 0.0653067 Nov 11 17:17:29.523890 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d3bcbf44-8275-410b-a891-b4b13f9e5bff admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:29.523890 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-d3bcbf44-8275-410b-a891-b4b13f9e5bff admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/16fa915a-0ce2-4da9-888b-efc8cf40e573 HTTP/1.1" status: 204 len: 168 time: 0.2543323 Nov 11 17:17:29.529887 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3bcbf44-8275-410b-a891-b4b13f9e5bff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=16fa915a-0ce2-4da9-888b-efc8cf40e573,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:29.611619 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2b89dc6c-b538-4628-bbad-a9ddbda607f4 req-a2f67ed9-0285-4786-ab0d-b955553f5538 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0783293 Nov 11 17:17:30.664802 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-934b1dcd-b45a-4985-8b3a-ea219c73b7e9 req-c147962e-3ea7-4857-8198-dc999cde38eb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:30.666389 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-934b1dcd-b45a-4985-8b3a-ea219c73b7e9 req-c147962e-3ea7-4857-8198-dc999cde38eb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0538547 Nov 11 17:17:30.750828 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f01fa3-21b3-444f-b133-0d945636c729 req-715d91d1-0c17-4f68-b4ac-e6a7213c3d90 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:30.756073 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-934b1dcd-b45a-4985-8b3a-ea219c73b7e9 req-86ff20d4-4c3e-429d-917e-deacc6180aa5 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811334 Nov 11 17:17:30.760470 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b8f01fa3-21b3-444f-b133-0d945636c729 req-715d91d1-0c17-4f68-b4ac-e6a7213c3d90 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 945 time: 0.0735614 Nov 11 17:17:30.819766 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b8f01fa3-21b3-444f-b133-0d945636c729 req-3161d1d7-0a4f-4d95-af3c-0a1ae20bd184 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0530226 Nov 11 17:17:30.975421 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-259cd94b-6700-490a-a4ae-a4e5cfff363d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:31.885381 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b7a6b1-11c3-4179-a59e-afcc2637594d req-c748739a-0771-46c8-9a6a-9b1fbb711dd0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:31.887022 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-83b7a6b1-11c3-4179-a59e-afcc2637594d req-c748739a-0771-46c8-9a6a-9b1fbb711dd0 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0544810 Nov 11 17:17:31.938811 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-83b7a6b1-11c3-4179-a59e-afcc2637594d req-45bbe927-5e7e-4662-a3d0-12fb0e244d53 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450864 Nov 11 17:17:31.939636 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71805958-64dd-44fa-bdff-c1e416a4a906 req-6dbf7c31-1e32-4086-80cb-89bb93a22d2e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:31.941189 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-71805958-64dd-44fa-bdff-c1e416a4a906 req-6dbf7c31-1e32-4086-80cb-89bb93a22d2e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 945 time: 0.0556536 Nov 11 17:17:32.021504 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-71805958-64dd-44fa-bdff-c1e416a4a906 req-7296969e-cf10-4db5-a85b-bcc2882eb509 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0740359 Nov 11 17:17:32.441094 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ba101f9-6356-43cd-b60f-5f84dd596532 req-3b561256-6e8f-490b-a34f-74a765ae9f38 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:32.442670 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9ba101f9-6356-43cd-b60f-5f84dd596532 req-3b561256-6e8f-490b-a34f-74a765ae9f38 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 1098 time: 0.0417008 Nov 11 17:17:32.496109 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9ba101f9-6356-43cd-b60f-5f84dd596532 req-c2f7f357-c90f-41ac-9e26-125f4ecb5dab service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439947 Nov 11 17:17:33.065895 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfd6ca5c-c264-4a5e-a9cd-0ba0527a9056 req-9c74ca67-2573-4ee5-875e-2d745a80f43a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:33.066776 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cfd6ca5c-c264-4a5e-a9cd-0ba0527a9056 req-9c74ca67-2573-4ee5-875e-2d745a80f43a tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0551157 Nov 11 17:17:33.142911 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cfd6ca5c-c264-4a5e-a9cd-0ba0527a9056 req-6133f447-7716-40d7-9491-422477765d85 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654573 Nov 11 17:17:33.157550 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af730afb-7f1a-4f4d-8c2a-16ca585bdc6f req-5fa68e4e-aff0-438b-9802-bab9634a4b74 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:33.159431 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-af730afb-7f1a-4f4d-8c2a-16ca585bdc6f req-5fa68e4e-aff0-438b-9802-bab9634a4b74 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 945 time: 0.0602996 Nov 11 17:17:33.214463 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-af730afb-7f1a-4f4d-8c2a-16ca585bdc6f req-4b2d2bd9-00af-47cf-9c16-ea08c609f3e6 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455389 Nov 11 17:17:33.495277 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-59e25e3a-6c6f-4d84-a26a-c735652ac617 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:34.269601 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b76fe62-71ec-43f7-969b-0ff5c607aa72 req-979d0bd5-1be6-4e1f-9436-69e32e49c3c9 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:34.271121 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7b76fe62-71ec-43f7-969b-0ff5c607aa72 req-979d0bd5-1be6-4e1f-9436-69e32e49c3c9 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0506437 Nov 11 17:17:34.319227 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7b76fe62-71ec-43f7-969b-0ff5c607aa72 req-5987310a-0685-4298-96bd-e7b36591c7be tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417945 Nov 11 17:17:34.332996 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93600bc6-9ffb-4ce5-9ea6-61dc51958b2b req-3a89163d-4693-47aa-861a-de6c47753a0a tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:34.335192 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-93600bc6-9ffb-4ce5-9ea6-61dc51958b2b req-3a89163d-4693-47aa-861a-de6c47753a0a tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 945 time: 0.0516067 Nov 11 17:17:34.385688 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-93600bc6-9ffb-4ce5-9ea6-61dc51958b2b req-a7775629-0d37-4337-a666-8aa8661bcefb tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444343 Nov 11 17:17:34.579889 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:35.435099 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61bea8d0-fa2c-4892-839d-a211e26d71f2 req-cb54da00-403d-4b39-8bcc-9d788c660d1e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:35.436603 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-61bea8d0-fa2c-4892-839d-a211e26d71f2 req-cb54da00-403d-4b39-8bcc-9d788c660d1e tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0502696 Nov 11 17:17:35.492622 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-61bea8d0-fa2c-4892-839d-a211e26d71f2 req-ad1b85af-a351-4b0b-81ae-393279963e13 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500169 Nov 11 17:17:35.504495 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27fcfa6c-065a-4b34-87af-e4f06e7ed3a1 req-c0ea8c6c-8209-43cc-a9b8-5c403979c034 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:35.506003 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-27fcfa6c-065a-4b34-87af-e4f06e7ed3a1 req-c0ea8c6c-8209-43cc-a9b8-5c403979c034 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 945 time: 0.0513310 Nov 11 17:17:35.560418 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-27fcfa6c-065a-4b34-87af-e4f06e7ed3a1 req-bd1c47e6-8b6d-4235-9028-a15074cc2d65 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478647 Nov 11 17:17:36.300059 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:36.608895 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad377617-1864-406c-adba-d55a7129edf4 req-6836e184-4976-4c60-b587-a517a6b8df60 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:36.610483 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ad377617-1864-406c-adba-d55a7129edf4 req-6836e184-4976-4c60-b587-a517a6b8df60 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0511384 Nov 11 17:17:36.663234 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ad377617-1864-406c-adba-d55a7129edf4 req-bfde90a7-28f6-4fe6-a82b-f24f44251e4d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460823 Nov 11 17:17:36.679630 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04bd6682-d61a-4ecd-8a87-96541d05014d req-45c228a7-9a6f-4b6d-a22b-6a619e81bc49 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:36.681786 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-04bd6682-d61a-4ecd-8a87-96541d05014d req-45c228a7-9a6f-4b6d-a22b-6a619e81bc49 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 945 time: 0.0514073 Nov 11 17:17:36.739153 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-04bd6682-d61a-4ecd-8a87-96541d05014d req-5d52bcf6-6f4f-4884-b420-9abf45a00f23 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477829 Nov 11 17:17:37.020309 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:37.103281 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-021e2afd-3a4d-4d7c-9182-d21966d4621b req-ffe81f0a-6fe7-4738-bae7-d7e08c650dc3 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:37.105239 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-021e2afd-3a4d-4d7c-9182-d21966d4621b req-ffe81f0a-6fe7-4738-bae7-d7e08c650dc3 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.10 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0501766 Nov 11 17:17:37.781546 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cbb6245-b560-447f-a80f-8387817a3c8b req-ccbd4e75-acc1-4015-a659-435872505e14 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:37.783110 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6cbb6245-b560-447f-a80f-8387817a3c8b req-ccbd4e75-acc1-4015-a659-435872505e14 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.0511651 Nov 11 17:17:37.863757 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bead06dd-d853-4727-b85b-d8ba60a61dd7 req-e0ce6443-479e-4e1e-8fce-fe4695a60c26 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:37.865403 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-bead06dd-d853-4727-b85b-d8ba60a61dd7 req-e0ce6443-479e-4e1e-8fce-fe4695a60c26 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 945 time: 0.0536995 Nov 11 17:17:37.926934 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-bead06dd-d853-4727-b85b-d8ba60a61dd7 req-185f2b99-f736-44aa-9a01-d2bfe99b0f3c tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0545089 Nov 11 17:17:38.057271 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6cbb6245-b560-447f-a80f-8387817a3c8b req-e68b113a-6084-43e9-ae6f-27f2aef353af tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2680874 Nov 11 17:17:38.070147 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-820c3952-00a3-4973-ba26-8bacf4472665 req-e9d1a536-8f6f-4ae4-8523-49db20a90e81 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:38.071779 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-820c3952-00a3-4973-ba26-8bacf4472665 req-e9d1a536-8f6f-4ae4-8523-49db20a90e81 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 945 time: 0.0622389 Nov 11 17:17:38.137102 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-820c3952-00a3-4973-ba26-8bacf4472665 req-41b7330e-42de-41bc-9629-1ee3f894c34e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0578339 Nov 11 17:17:38.159498 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 33728) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:38.347918 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0186113a-c996-496d-89a4-eeb5c4a835af tempest-TestVolumeBootPattern-934397991 tempest-TestVolumeBootPattern-934397991-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:38.349418 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-0186113a-c996-496d-89a4-eeb5c4a835af tempest-TestVolumeBootPattern-934397991 tempest-TestVolumeBootPattern-934397991-project-admin] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 1093 time: 0.1888092 Nov 11 17:17:38.352996 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 33734) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:38.357450 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Request body: {'floatingip': {'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'port_id': '187c87f3-1a3e-48da-b88a-46d1ee4144ea', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address': '172.20.0.5'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:17:38.454225 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for floatingip, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:38.560500 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:38.663954 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Allocated IP 172.27.1.254 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/802e1a48-f360-4544-b1c7-4ffe24ce9585) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:17:38.773355 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:38.854831 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:38.894524 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:17:38.897426 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:17:38.902433 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:17:38.908446 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event updated for resources: {'Port': ['ID=802e1a48-f360-4544-b1c7-4ffe24ce9585,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:39.222919 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-021e2afd-3a4d-4d7c-9182-d21966d4621b req-ff580c81-492f-453f-8bc7-fcd85772d0ba tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Deleting port 56aa9732-ebeb-41d7-ae07-03020a710285 {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:17:39.223256 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-021e2afd-3a4d-4d7c-9182-d21966d4621b req-ff580c81-492f-453f-8bc7-fcd85772d0ba tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:39.278774 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80734b9d-c7e0-4c09-b606-76d6761aaeff req-b758e1ac-7434-469f-8258-0e255112d323 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:39.280281 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-80734b9d-c7e0-4c09-b606-76d6761aaeff req-b758e1ac-7434-469f-8258-0e255112d323 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 945 time: 0.1238794 Nov 11 17:17:39.549553 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-80734b9d-c7e0-4c09-b606-76d6761aaeff req-7ed5c06b-af17-498a-b46d-ff831cc8ca80 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2363772 Nov 11 17:17:39.572764 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-021e2afd-3a4d-4d7c-9182-d21966d4621b req-ff580c81-492f-453f-8bc7-fcd85772d0ba tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] For port 56aa9732-ebeb-41d7-ae07-03020a710285, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=56aa9732-ebeb-41d7-ae07-03020a710285,segment=NetworkSegment(5eacaa77-ea76-482f-aec2-5adad8f8bde5),segment_id=5eacaa77-ea76-482f-aec2-5adad8f8bde5)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:17:39.573129 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-021e2afd-3a4d-4d7c-9182-d21966d4621b req-ff580c81-492f-453f-8bc7-fcd85772d0ba tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:39.605223 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-021e2afd-3a4d-4d7c-9182-d21966d4621b req-ff580c81-492f-453f-8bc7-fcd85772d0ba tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Calling delete_port for 56aa9732-ebeb-41d7-ae07-03020a710285 owned by compute:nova {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:17:39.623019 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:39.845637 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:39.902913 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-021e2afd-3a4d-4d7c-9182-d21966d4621b req-ff580c81-492f-453f-8bc7-fcd85772d0ba tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:39.967219 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff580c81-492f-453f-8bc7-fcd85772d0ba tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Pushing event deleted for resources: {'Port': ['ID=56aa9732-ebeb-41d7-ae07-03020a710285,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:40.009466 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['904b538c-2fcd-42a3-bc02-26c84d4d00cb', '56aa9732-ebeb-41d7-ae07-03020a710285'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:17:40.028596 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-021e2afd-3a4d-4d7c-9182-d21966d4621b req-ff580c81-492f-453f-8bc7-fcd85772d0ba tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] No DVR routers for this DVR port 56aa9732-ebeb-41d7-ae07-03020a710285 on host hv-cinder-69414 {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:17:40.032467 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-021e2afd-3a4d-4d7c-9182-d21966d4621b req-ff580c81-492f-453f-8bc7-fcd85772d0ba tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:40.035880 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-021e2afd-3a4d-4d7c-9182-d21966d4621b req-ff580c81-492f-453f-8bc7-fcd85772d0ba tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.10 "DELETE /v2.0/ports/56aa9732-ebeb-41d7-ae07-03020a710285 HTTP/1.1" status: 204 len: 173 time: 1.0640497 Nov 11 17:17:40.036338 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b317717e-d56a-49b7-9299-673bccd53ede', 'name': 'network-vif-deleted', 'tag': '56aa9732-ebeb-41d7-ae07-03020a710285'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:17:40.038625 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8c0223cb-09a0-4aca-850d-813431e44932" -d '{"events": [{"server_uuid": "b317717e-d56a-49b7-9299-673bccd53ede", "name": "network-vif-deleted", "tag": "56aa9732-ebeb-41d7-ae07-03020a710285"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:17:40.082828 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:17:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c7a655b9-d23f-4c60-bd62-a1dc46cf0ec1 x-openstack-request-id: req-c7a655b9-d23f-4c60-bd62-a1dc46cf0ec1 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:17:40.083159 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b317717e-d56a-49b7-9299-673bccd53ede", "name": "network-vif-deleted", "tag": "56aa9732-ebeb-41d7-ae07-03020a710285", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:17:40.083606 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-c7a655b9-d23f-4c60-bd62-a1dc46cf0ec1 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:17:40.083752 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b317717e-d56a-49b7-9299-673bccd53ede', 'name': 'network-vif-deleted', 'tag': '56aa9732-ebeb-41d7-ae07-03020a710285', 'status': 'completed', 'code': 200} Nov 11 17:17:40.088583 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:40.179527 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:40.473558 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event updated for resources: {'Port': ['ID=802e1a48-f360-4544-b1c7-4ffe24ce9585,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:40.490504 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:40.597578 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.l3_db [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Floating IP ba992ca3-6bc4-4506-b0c1-1099a040a0fb associated. External IP: 172.27.1.254, port: 187c87f3-1a3e-48da-b88a-46d1ee4144ea. Nov 11 17:17:40.667229 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-189ee1e6-2058-45a4-84fc-14fc3833d714 req-b4bed052-3d9a-4a51-98a9-97271b83a96c tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=b317717e-d56a-49b7-9299-673bccd53ede HTTP/1.1" status: 200 len: 210 time: 0.0339355 Nov 11 17:17:40.851599 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 56aa9732-ebeb-41d7-ae07-03020a710285 no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:17:40.852357 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Router 1267b92b-e259-4df2-9704-b862470a9e03 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:17:40.873284 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: 56aa9732-ebeb-41d7-ae07-03020a710285 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:17:40.873633 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 56aa9732-ebeb-41d7-ae07-03020a710285 not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:17:40.978711 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:17:40.993431 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d452ed6c-f85a-4fdc-a96f-b8ad945cc56b None None] Sync routers for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:17:41.009855 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d452ed6c-f85a-4fdc-a96f-b8ad945cc56b None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:17:41.010949 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-d452ed6c-f85a-4fdc-a96f-b8ad945cc56b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:17:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:17:41.090931 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:41.134646 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-8bbdcf36-4fb9-4ba1-8ba8-cc09682c93ac tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.7801936 Nov 11 17:17:41.145866 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-d452ed6c-f85a-4fdc-a96f-b8ad945cc56b None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:17:41.495533 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-d452ed6c-f85a-4fdc-a96f-b8ad945cc56b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': 'ba992ca3-6bc4-4506-b0c1-1099a040a0fb', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'floating_ip_address': '172.27.1.254', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'port_id': '187c87f3-1a3e-48da-b88a-46d1ee4144ea', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 500, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'mac_address': 'fa:16:3e:be:39:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d252f56-dd95-4edc-b002-65db4d8fc4d8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:17:39Z', 'updated_at': '2021-11-11T17:17:39Z', 'revision_number': 0, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:17:41.530107 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d452ed6c-f85a-4fdc-a96f-b8ad945cc56b None None] Checking router: 1267b92b-e259-4df2-9704-b862470a9e03 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:17:41.549186 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d452ed6c-f85a-4fdc-a96f-b8ad945cc56b None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:17:41.550017 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-d452ed6c-f85a-4fdc-a96f-b8ad945cc56b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:17:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:17:41.668694 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-d452ed6c-f85a-4fdc-a96f-b8ad945cc56b None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:17:41.940428 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-d452ed6c-f85a-4fdc-a96f-b8ad945cc56b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': 'ba992ca3-6bc4-4506-b0c1-1099a040a0fb', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'floating_ip_address': '172.27.1.254', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'port_id': '187c87f3-1a3e-48da-b88a-46d1ee4144ea', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 500, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'mac_address': 'fa:16:3e:be:39:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d252f56-dd95-4edc-b002-65db4d8fc4d8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:17:39Z', 'updated_at': '2021-11-11T17:17:39Z', 'revision_number': 0, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:17:41.973094 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d452ed6c-f85a-4fdc-a96f-b8ad945cc56b None None] The sync data for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi is: [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': 'ba992ca3-6bc4-4506-b0c1-1099a040a0fb', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'floating_ip_address': '172.27.1.254', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'port_id': '187c87f3-1a3e-48da-b88a-46d1ee4144ea', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 500, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'mac_address': 'fa:16:3e:be:39:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d252f56-dd95-4edc-b002-65db4d8fc4d8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:17:39Z', 'updated_at': '2021-11-11T17:17:39Z', 'revision_number': 0, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:17:42.084637 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0d252f56-dd95-4edc-b002-65db4d8fc4d8', 'tag': '187c87f3-1a3e-48da-b88a-46d1ee4144ea'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:17:42.089752 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-017787b6-51f3-4829-a50e-67f80e0b691c" -d '{"events": [{"name": "network-changed", "server_uuid": "0d252f56-dd95-4edc-b002-65db4d8fc4d8", "tag": "187c87f3-1a3e-48da-b88a-46d1ee4144ea"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:17:42.130689 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:17:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e324495c-b080-468e-85b9-a993a03a853c x-openstack-request-id: req-e324495c-b080-468e-85b9-a993a03a853c {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:17:42.131233 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0d252f56-dd95-4edc-b002-65db4d8fc4d8", "tag": "187c87f3-1a3e-48da-b88a-46d1ee4144ea", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:17:42.131664 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-e324495c-b080-468e-85b9-a993a03a853c {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:17:42.132160 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0d252f56-dd95-4edc-b002-65db4d8fc4d8', 'tag': '187c87f3-1a3e-48da-b88a-46d1ee4144ea', 'status': 'completed', 'code': 200} Nov 11 17:17:42.217503 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2909f182-edb3-4dfb-bcf7-b729bcce6160 None None] New status for floating IP ba992ca3-6bc4-4506-b0c1-1099a040a0fb: ACTIVE {{(pid=102325) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:17:42.260273 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-017787b6-51f3-4829-a50e-67f80e0b691c req-a1097089-4347-4931-8c0b-e5ed7cadb96e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:42.263020 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-017787b6-51f3-4829-a50e-67f80e0b691c req-a1097089-4347-4931-8c0b-e5ed7cadb96e service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 1098 time: 0.0893991 Nov 11 17:17:42.334855 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df0abb0b-7f32-4ab9-9039-6e84ab81fb83 req-61470433-7106-457c-b995-62635a7539b9 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:42.338143 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-df0abb0b-7f32-4ab9-9039-6e84ab81fb83 req-61470433-7106-457c-b995-62635a7539b9 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0698702 Nov 11 17:17:42.410957 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-df0abb0b-7f32-4ab9-9039-6e84ab81fb83 req-49eff35b-edf0-4de4-a0ec-9ffd5f080540 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667853 Nov 11 17:17:42.414271 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-017787b6-51f3-4829-a50e-67f80e0b691c req-1f76e5ca-d5f8-4bde-9a04-b6fb2e4e1958 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:42.416401 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-017787b6-51f3-4829-a50e-67f80e0b691c req-1f76e5ca-d5f8-4bde-9a04-b6fb2e4e1958 service neutron] 10.222.0.10 "GET /v2.0/networks?id=45e6626a-2007-490b-a445-d7c3baea689e HTTP/1.1" status: 200 len: 912 time: 0.1448002 Nov 11 17:17:42.496825 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-017787b6-51f3-4829-a50e-67f80e0b691c req-e13c1396-6854-4ffd-939e-05d0a71a2d4f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=187c87f3-1a3e-48da-b88a-46d1ee4144ea HTTP/1.1" status: 200 len: 999 time: 0.0633647 Nov 11 17:17:42.547981 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-017787b6-51f3-4829-a50e-67f80e0b691c req-a8731266-a563-4699-bb9c-42f430daeb93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:42.549572 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-017787b6-51f3-4829-a50e-67f80e0b691c req-a8731266-a563-4699-bb9c-42f430daeb93 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=bf78c82f-f2f3-4ef7-8052-be816dbd2df8 HTTP/1.1" status: 200 len: 850 time: 0.0448666 Nov 11 17:17:42.606803 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-017787b6-51f3-4829-a50e-67f80e0b691c req-0e7231b0-d81c-4656-ba40-a099c2bb8b74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:42.608349 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-017787b6-51f3-4829-a50e-67f80e0b691c req-0e7231b0-d81c-4656-ba40-a099c2bb8b74 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=45e6626a-2007-490b-a445-d7c3baea689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0503447 Nov 11 17:17:42.711786 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-017787b6-51f3-4829-a50e-67f80e0b691c req-5e0c4ae7-6b33-4098-8bcd-d5535efdaf6c service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0893154 Nov 11 17:17:42.820290 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-017787b6-51f3-4829-a50e-67f80e0b691c req-7e3105f4-3eeb-4a12-a798-2b3319a599a6 service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0907056 Nov 11 17:17:43.556498 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47f7932c-5fe5-435e-978d-737fa62b3a1d req-98a4e9e8-b837-4e42-be13-d2ac56950b65 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:43.558014 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-47f7932c-5fe5-435e-978d-737fa62b3a1d req-98a4e9e8-b837-4e42-be13-d2ac56950b65 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0721068 Nov 11 17:17:43.609719 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-47f7932c-5fe5-435e-978d-737fa62b3a1d req-10e19846-2478-48a7-be58-68eaa12640cf tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450451 Nov 11 17:17:43.749110 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 33812) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:43.872093 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:43.963067 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:44.042218 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:44.086501 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=304bf8a6-dc1d-4f41-bcdb-bdfbb5c01f0f,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:44.090308 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=cdf01f671098410e85f1a8f567f16e89&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3401582 Nov 11 17:17:44.093278 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 33824) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:44.096411 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:44.096755 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:44.097089 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:44.097417 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:44.097752 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:44.098082 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:44.101207 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:44.101568 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:44.101906 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:44.102266 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:44.102578 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:44.102943 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4744072-5a08-4ca2-a102-11bd50fb33e0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:17:44.138637 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:17:44.168848 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a7d9cfbe-5c6e-401e-93bb-9c7bcd95f0e0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:44.201650 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a7d9cfbe-5c6e-401e-93bb-9c7bcd95f0e0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:44.356175 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a7d9cfbe-5c6e-401e-93bb-9c7bcd95f0e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:44.359850 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a7d9cfbe-5c6e-401e-93bb-9c7bcd95f0e0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:44.363762 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-a7d9cfbe-5c6e-401e-93bb-9c7bcd95f0e0 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/304bf8a6-dc1d-4f41-bcdb-bdfbb5c01f0f HTTP/1.1" status: 204 len: 168 time: 0.2694490 Nov 11 17:17:44.374830 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7d9cfbe-5c6e-401e-93bb-9c7bcd95f0e0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=304bf8a6-dc1d-4f41-bcdb-bdfbb5c01f0f,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:44.573030 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 33836) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:44.748577 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cc00556-40ff-4ea4-9280-3650e4f4d54b req-3c973522-3160-46cb-b8a5-f91b47ed56d9 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:44.750256 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5cc00556-40ff-4ea4-9280-3650e4f4d54b req-3c973522-3160-46cb-b8a5-f91b47ed56d9 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0571017 Nov 11 17:17:44.806662 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5cc00556-40ff-4ea4-9280-3650e4f4d54b req-16462b0c-cbac-49bf-9a59-84cc1792461d tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500405 Nov 11 17:17:44.844145 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-34f113fc-ed32-44a7-a53e-bbecbc00b18c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:44.923234 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-34f113fc-ed32-44a7-a53e-bbecbc00b18c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:44.985354 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-34f113fc-ed32-44a7-a53e-bbecbc00b18c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:45.023863 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-34f113fc-ed32-44a7-a53e-bbecbc00b18c admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=5f1a88e4d3cf4640b92be771996d949e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4497037 Nov 11 17:17:45.024736 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34f113fc-ed32-44a7-a53e-bbecbc00b18c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9203a7da-d45c-4ab4-8d72-bd1849ca4c19,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:45.028661 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 33842) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:45.088778 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f956ef41-88a5-4b55-8332-99a626ed65a2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:45.115523 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f956ef41-88a5-4b55-8332-99a626ed65a2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:45.253129 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f956ef41-88a5-4b55-8332-99a626ed65a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:45.256345 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f956ef41-88a5-4b55-8332-99a626ed65a2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:45.257719 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-f956ef41-88a5-4b55-8332-99a626ed65a2 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/9203a7da-d45c-4ab4-8d72-bd1849ca4c19 HTTP/1.1" status: 204 len: 168 time: 0.2278306 Nov 11 17:17:45.268950 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f956ef41-88a5-4b55-8332-99a626ed65a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9203a7da-d45c-4ab4-8d72-bd1849ca4c19,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:45.943995 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-167a2b4f-4c51-4a37-a7d5-36d4539e8b7b req-dba2e676-a1c8-4313-91d1-454222857bfb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:45.945503 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-167a2b4f-4c51-4a37-a7d5-36d4539e8b7b req-dba2e676-a1c8-4313-91d1-454222857bfb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0575864 Nov 11 17:17:46.002240 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-167a2b4f-4c51-4a37-a7d5-36d4539e8b7b req-657fcfb8-1b64-487c-9403-64735dbf8dfc tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493286 Nov 11 17:17:46.865461 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:46.892383 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3bfc2f4-023a-48b2-b333-d6d04e5dfd63 req-727178f7-0c9d-4e43-bdea-0bf6a220bc13 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:46.894127 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b3bfc2f4-023a-48b2-b333-d6d04e5dfd63 req-727178f7-0c9d-4e43-bdea-0bf6a220bc13 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 945 time: 0.0553372 Nov 11 17:17:46.946348 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b3bfc2f4-023a-48b2-b333-d6d04e5dfd63 req-26dfb773-2af4-4a0d-971f-3d8df99c7c20 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451210 Nov 11 17:17:47.150651 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-093649ff-c0db-4c52-bf96-37ffd8c99504 req-3df59bd1-d6bd-4b77-8ad6-239df1b046e2 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:47.153385 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-093649ff-c0db-4c52-bf96-37ffd8c99504 req-3df59bd1-d6bd-4b77-8ad6-239df1b046e2 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0733550 Nov 11 17:17:47.207409 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-093649ff-c0db-4c52-bf96-37ffd8c99504 req-f45377ec-feb7-4e71-b67c-4b8166539f50 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480757 Nov 11 17:17:48.083238 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a248e6-632e-4d3d-b1b6-e1432ded45fa req-cbc97103-2f48-4845-8c8e-795287afc016 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:48.085958 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d9a248e6-632e-4d3d-b1b6-e1432ded45fa req-cbc97103-2f48-4845-8c8e-795287afc016 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 945 time: 0.0549197 Nov 11 17:17:48.140852 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d9a248e6-632e-4d3d-b1b6-e1432ded45fa req-4cb460d8-08ea-4e20-8507-8b085aea65b3 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454805 Nov 11 17:17:48.329341 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cd58d13-fd37-4325-b3d5-9f7032f49c24 req-8e330002-996f-43bf-8384-2ef7b3fdaccc tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:48.331023 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3cd58d13-fd37-4325-b3d5-9f7032f49c24 req-8e330002-996f-43bf-8384-2ef7b3fdaccc tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.0521717 Nov 11 17:17:48.386312 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3cd58d13-fd37-4325-b3d5-9f7032f49c24 req-38835bdf-b333-42a9-b9e6-acaa12a20991 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439825 Nov 11 17:17:49.022414 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a7e3035-6b5d-48c6-8f62-8bfc74c61316 req-f7fdba96-c08f-43b3-a7bb-270529d3d2d6 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:49.023918 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2a7e3035-6b5d-48c6-8f62-8bfc74c61316 req-f7fdba96-c08f-43b3-a7bb-270529d3d2d6 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.10 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 945 time: 0.0490661 Nov 11 17:17:49.133400 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-2a7e3035-6b5d-48c6-8f62-8bfc74c61316 req-7149f55a-b063-415f-8a7f-231ca21b876c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Deleting port 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:17:49.133780 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-2a7e3035-6b5d-48c6-8f62-8bfc74c61316 req-7149f55a-b063-415f-8a7f-231ca21b876c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:49.245222 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-2a7e3035-6b5d-48c6-8f62-8bfc74c61316 req-7149f55a-b063-415f-8a7f-231ca21b876c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] For port 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=330af06b-68e4-4b3c-97ad-35d8cbfb0d3f,segment=NetworkSegment(92668025-4f51-4378-b7fa-fd59b584fd19),segment_id=92668025-4f51-4378-b7fa-fd59b584fd19)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:17:49.245794 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-2a7e3035-6b5d-48c6-8f62-8bfc74c61316 req-7149f55a-b063-415f-8a7f-231ca21b876c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:49.273867 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-2a7e3035-6b5d-48c6-8f62-8bfc74c61316 req-7149f55a-b063-415f-8a7f-231ca21b876c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Calling delete_port for 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f owned by compute:nova {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:17:49.358241 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7e9420b-caf4-4698-bdda-3aa5c0b1aca6 req-cafb5526-e1e7-462f-a1ed-91d996821169 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:49.360701 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a7e9420b-caf4-4698-bdda-3aa5c0b1aca6 req-cafb5526-e1e7-462f-a1ed-91d996821169 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 945 time: 0.1316404 Nov 11 17:17:49.375682 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199803ef-df1a-4819-8de6-7c225a305f82 req-bbc8b33e-fb05-49d8-b6c1-35e1b5895ddb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:49.377428 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-199803ef-df1a-4819-8de6-7c225a305f82 req-bbc8b33e-fb05-49d8-b6c1-35e1b5895ddb tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.10 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.1350513 Nov 11 17:17:49.521673 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-2a7e3035-6b5d-48c6-8f62-8bfc74c61316 req-7149f55a-b063-415f-8a7f-231ca21b876c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:49.536833 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['330af06b-68e4-4b3c-97ad-35d8cbfb0d3f'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:17:49.557189 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a7e9420b-caf4-4698-bdda-3aa5c0b1aca6 req-bd8b3aa1-4b77-489b-97e6-ea21dfc85b4b tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1783171 Nov 11 17:17:49.613047 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7149f55a-b063-415f-8a7f-231ca21b876c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Pushing event deleted for resources: {'Port': ['ID=330af06b-68e4-4b3c-97ad-35d8cbfb0d3f,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:49.627315 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [req-199803ef-df1a-4819-8de6-7c225a305f82 req-0ff057ad-99f9-4f9c-bcbe-2db68b069969 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Deleting port 904b538c-2fcd-42a3-bc02-26c84d4d00cb {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:17:49.627848 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-199803ef-df1a-4819-8de6-7c225a305f82 req-0ff057ad-99f9-4f9c-bcbe-2db68b069969 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:49.658874 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e10e6373-7c80-4313-bc57-fd41722ae3ac req-b857c49f-4950-43f1-b997-534e0d5f7704 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:49.660855 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e10e6373-7c80-4313-bc57-fd41722ae3ac req-b857c49f-4950-43f1-b997-534e0d5f7704 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 945 time: 0.1530130 Nov 11 17:17:49.687160 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a7e3035-6b5d-48c6-8f62-8bfc74c61316 req-7149f55a-b063-415f-8a7f-231ca21b876c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] No DVR routers for this DVR port 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f on host hv-cinder-69414 {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:17:49.693720 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-2a7e3035-6b5d-48c6-8f62-8bfc74c61316 req-7149f55a-b063-415f-8a7f-231ca21b876c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:49.697220 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2a7e3035-6b5d-48c6-8f62-8bfc74c61316 req-7149f55a-b063-415f-8a7f-231ca21b876c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.10 "DELETE /v2.0/ports/330af06b-68e4-4b3c-97ad-35d8cbfb0d3f HTTP/1.1" status: 204 len: 173 time: 0.6627870 Nov 11 17:17:49.697692 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2303d567-a912-4483-ac64-49b3feb3aa47', 'name': 'network-vif-deleted', 'tag': '330af06b-68e4-4b3c-97ad-35d8cbfb0d3f'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:17:49.700468 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cf759f67-5fff-4693-992f-a444394a4e1b" -d '{"events": [{"server_uuid": "2303d567-a912-4483-ac64-49b3feb3aa47", "name": "network-vif-deleted", "tag": "330af06b-68e4-4b3c-97ad-35d8cbfb0d3f"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:17:49.744229 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:17:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0081caab-08a8-4fe9-9f8b-321d3f53417d x-openstack-request-id: req-0081caab-08a8-4fe9-9f8b-321d3f53417d {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:17:49.747707 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2303d567-a912-4483-ac64-49b3feb3aa47", "name": "network-vif-deleted", "tag": "330af06b-68e4-4b3c-97ad-35d8cbfb0d3f", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:17:49.747707 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-0081caab-08a8-4fe9-9f8b-321d3f53417d {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:17:49.747707 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2303d567-a912-4483-ac64-49b3feb3aa47', 'name': 'network-vif-deleted', 'tag': '330af06b-68e4-4b3c-97ad-35d8cbfb0d3f', 'status': 'completed', 'code': 200} Nov 11 17:17:49.772309 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-199803ef-df1a-4819-8de6-7c225a305f82 req-0ff057ad-99f9-4f9c-bcbe-2db68b069969 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] For port 904b538c-2fcd-42a3-bc02-26c84d4d00cb, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=904b538c-2fcd-42a3-bc02-26c84d4d00cb,segment=NetworkSegment(5eacaa77-ea76-482f-aec2-5adad8f8bde5),segment_id=5eacaa77-ea76-482f-aec2-5adad8f8bde5)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:17:49.772811 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-199803ef-df1a-4819-8de6-7c225a305f82 req-0ff057ad-99f9-4f9c-bcbe-2db68b069969 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:49.782329 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e10e6373-7c80-4313-bc57-fd41722ae3ac req-3a3c3983-aaa4-4a67-8629-2acaf803e765 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/security-groups?id=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0962870 Nov 11 17:17:49.796501 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [req-199803ef-df1a-4819-8de6-7c225a305f82 req-0ff057ad-99f9-4f9c-bcbe-2db68b069969 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Calling delete_port for 904b538c-2fcd-42a3-bc02-26c84d4d00cb owned by compute:nova {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:17:50.264013 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-199803ef-df1a-4819-8de6-7c225a305f82 req-0ff057ad-99f9-4f9c-bcbe-2db68b069969 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:50.278961 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['904b538c-2fcd-42a3-bc02-26c84d4d00cb'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:17:50.305547 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ff057ad-99f9-4f9c-bcbe-2db68b069969 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Pushing event deleted for resources: {'Port': ['ID=904b538c-2fcd-42a3-bc02-26c84d4d00cb,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:50.366790 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [req-199803ef-df1a-4819-8de6-7c225a305f82 req-0ff057ad-99f9-4f9c-bcbe-2db68b069969 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] No DVR routers for this DVR port 904b538c-2fcd-42a3-bc02-26c84d4d00cb on host hv-cinder-69414 {{(pid=102323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:17:50.370272 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-199803ef-df1a-4819-8de6-7c225a305f82 req-0ff057ad-99f9-4f9c-bcbe-2db68b069969 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:50.373639 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-199803ef-df1a-4819-8de6-7c225a305f82 req-0ff057ad-99f9-4f9c-bcbe-2db68b069969 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.10 "DELETE /v2.0/ports/904b538c-2fcd-42a3-bc02-26c84d4d00cb HTTP/1.1" status: 204 len: 173 time: 0.9869139 Nov 11 17:17:50.374091 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda', 'name': 'network-vif-deleted', 'tag': '904b538c-2fcd-42a3-bc02-26c84d4d00cb'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:17:50.376347 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0bedd6a2-6b76-436b-ac35-5fc9ac3b7638" -d '{"events": [{"server_uuid": "ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda", "name": "network-vif-deleted", "tag": "904b538c-2fcd-42a3-bc02-26c84d4d00cb"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:17:50.414988 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:17:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d29e4933-3b04-43d8-a0a2-8a9fd84e378a x-openstack-request-id: req-d29e4933-3b04-43d8-a0a2-8a9fd84e378a {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:17:50.415454 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda", "name": "network-vif-deleted", "tag": "904b538c-2fcd-42a3-bc02-26c84d4d00cb", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:17:50.415912 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-d29e4933-3b04-43d8-a0a2-8a9fd84e378a {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:17:50.416547 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda', 'name': 'network-vif-deleted', 'tag': '904b538c-2fcd-42a3-bc02-26c84d4d00cb', 'status': 'completed', 'code': 200} Nov 11 17:17:50.704749 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-630b915b-1749-4dce-a077-b3f66e0102df req-bf7d307c-d573-48b5-9c9f-7d76c82a880e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=2303d567-a912-4483-ac64-49b3feb3aa47 HTTP/1.1" status: 200 len: 210 time: 0.0319693 Nov 11 17:17:50.902125 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f26442a6-c667-4ccc-954c-f6d0391dcdd0 req-075315e9-1da8-4de2-b44d-93fae05cdb56 tempest-ServerRescueNegativeTestJSON-191419587 tempest-ServerRescueNegativeTestJSON-191419587-project] 10.222.0.16 "GET /v2.0/ports?device_id=ccca6e3a-8fbc-4cbe-8be7-46276d8b0cda HTTP/1.1" status: 200 len: 210 time: 0.0263016 Nov 11 17:17:51.966826 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 33884) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:52.423612 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-8c2bf935-2dd8-4da7-8ded-12b2177e3cfe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-394221'] for router_interface, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:52.718865 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-8c2bf935-2dd8-4da7-8ded-12b2177e3cfe admin admin] Deleting port 94af5a65-b91a-4134-9a23-8e8a8229d743 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:17:52.719085 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-8c2bf935-2dd8-4da7-8ded-12b2177e3cfe admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:52.802646 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-8c2bf935-2dd8-4da7-8ded-12b2177e3cfe admin admin] For port 94af5a65-b91a-4134-9a23-8e8a8229d743, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=94af5a65-b91a-4134-9a23-8e8a8229d743,segment=NetworkSegment(5eacaa77-ea76-482f-aec2-5adad8f8bde5),segment_id=5eacaa77-ea76-482f-aec2-5adad8f8bde5)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:17:52.803041 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-8c2bf935-2dd8-4da7-8ded-12b2177e3cfe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:52.817201 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-8c2bf935-2dd8-4da7-8ded-12b2177e3cfe admin admin] Calling delete_port for 94af5a65-b91a-4134-9a23-8e8a8229d743 owned by network:router_interface {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:17:53.064381 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-8c2bf935-2dd8-4da7-8ded-12b2177e3cfe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:53.090656 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c2bf935-2dd8-4da7-8ded-12b2177e3cfe admin admin] Pushing event deleted for resources: {'Port': ['ID=94af5a65-b91a-4134-9a23-8e8a8229d743,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:53.258161 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-8c2bf935-2dd8-4da7-8ded-12b2177e3cfe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8103781', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-393853'] for router_interface, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:53.451827 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:17:53.471311 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:17:53.471645 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 330af06b-68e4-4b3c-97ad-35d8cbfb0d3f not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:17:53.472058 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 904b538c-2fcd-42a3-bc02-26c84d4d00cb no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:17:53.472258 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8c2bf935-2dd8-4da7-8ded-12b2177e3cfe admin admin] Router 08374e94-6af9-4594-a1ea-925638c38b21 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:17:53.491591 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: 904b538c-2fcd-42a3-bc02-26c84d4d00cb {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:17:53.491933 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 904b538c-2fcd-42a3-bc02-26c84d4d00cb not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:17:53.580226 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8c2bf935-2dd8-4da7-8ded-12b2177e3cfe admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:17:53.587529 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-8c2bf935-2dd8-4da7-8ded-12b2177e3cfe admin admin] 10.222.0.16 "PUT /v2.0/routers/08374e94-6af9-4594-a1ea-925638c38b21/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6172802 Nov 11 17:17:53.588665 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 33890) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:53.591489 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3228a628-930a-49ed-82d5-008f29b73767 None None] Sync routers for ids ['08374e94-6af9-4594-a1ea-925638c38b21'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:17:53.604727 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3228a628-930a-49ed-82d5-008f29b73767 None None] Routers {'08374e94-6af9-4594-a1ea-925638c38b21'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:17:53.605449 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-3228a628-930a-49ed-82d5-008f29b73767 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:17:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['08374e94-6af9-4594-a1ea-925638c38b21'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:17:53.696907 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c539eeaa-aba7-4332-bdc1-fb54ae619bea admin admin] Publish callbacks [] for router, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:53.714772 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-3228a628-930a-49ed-82d5-008f29b73767 None None] Set router 08374e94-6af9-4594-a1ea-925638c38b21 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:17:53.918967 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-3228a628-930a-49ed-82d5-008f29b73767 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08374e94-6af9-4594-a1ea-925638c38b21', 'name': 'tempest-ServerRescueNegativeTestJSON-797046329-router', 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93'}], 'enable_snat': True}, 'gw_port_id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:17:52Z', 'revision_number': 5, 'project_id': 'ed26d137d98846b9b45708f7e581e9b0', 'gw_port': {'id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:79:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08374e94-6af9-4594-a1ea-925638c38b21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:12Z', 'updated_at': '2021-11-11T17:14:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:17:53.947650 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3228a628-930a-49ed-82d5-008f29b73767 None None] Checking router: 08374e94-6af9-4594-a1ea-925638c38b21 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:17:53.958076 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3228a628-930a-49ed-82d5-008f29b73767 None None] Routers {'08374e94-6af9-4594-a1ea-925638c38b21'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:17:53.958733 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-3228a628-930a-49ed-82d5-008f29b73767 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:17:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['08374e94-6af9-4594-a1ea-925638c38b21'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:17:54.052237 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c539eeaa-aba7-4332-bdc1-fb54ae619bea admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:54.068579 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-3228a628-930a-49ed-82d5-008f29b73767 None None] Set router 08374e94-6af9-4594-a1ea-925638c38b21 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:17:54.175030 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-c539eeaa-aba7-4332-bdc1-fb54ae619bea admin admin] Deleting port 45f4ef34-f554-4b7d-b2f8-8195d31d3841 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:17:54.175645 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c539eeaa-aba7-4332-bdc1-fb54ae619bea admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:54.260594 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-3228a628-930a-49ed-82d5-008f29b73767 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08374e94-6af9-4594-a1ea-925638c38b21', 'name': 'tempest-ServerRescueNegativeTestJSON-797046329-router', 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93'}], 'enable_snat': True}, 'gw_port_id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:17:52Z', 'revision_number': 5, 'project_id': 'ed26d137d98846b9b45708f7e581e9b0', 'gw_port': {'id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:79:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08374e94-6af9-4594-a1ea-925638c38b21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:12Z', 'updated_at': '2021-11-11T17:14:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:17:54.266653 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-c539eeaa-aba7-4332-bdc1-fb54ae619bea admin admin] For port 45f4ef34-f554-4b7d-b2f8-8195d31d3841, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=45f4ef34-f554-4b7d-b2f8-8195d31d3841,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:17:54.267041 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c539eeaa-aba7-4332-bdc1-fb54ae619bea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:54.281430 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-c539eeaa-aba7-4332-bdc1-fb54ae619bea admin admin] Calling delete_port for 45f4ef34-f554-4b7d-b2f8-8195d31d3841 owned by network:router_gateway {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:17:54.292298 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3228a628-930a-49ed-82d5-008f29b73767 None None] The sync data for ids ['08374e94-6af9-4594-a1ea-925638c38b21'] in dv-cinder-694140-2-iscsi is: [{'id': '08374e94-6af9-4594-a1ea-925638c38b21', 'name': 'tempest-ServerRescueNegativeTestJSON-797046329-router', 'tenant_id': 'ed26d137d98846b9b45708f7e581e9b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93'}], 'enable_snat': True}, 'gw_port_id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:17:52Z', 'revision_number': 5, 'project_id': 'ed26d137d98846b9b45708f7e581e9b0', 'gw_port': {'id': '45f4ef34-f554-4b7d-b2f8-8195d31d3841', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:79:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08374e94-6af9-4594-a1ea-925638c38b21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:12Z', 'updated_at': '2021-11-11T17:14:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:17:54.556761 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c539eeaa-aba7-4332-bdc1-fb54ae619bea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:54.586867 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c539eeaa-aba7-4332-bdc1-fb54ae619bea admin admin] Pushing event deleted for resources: {'Port': ['ID=45f4ef34-f554-4b7d-b2f8-8195d31d3841,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:54.654990 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c539eeaa-aba7-4332-bdc1-fb54ae619bea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-397207'] for router_gateway, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:54.767603 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c539eeaa-aba7-4332-bdc1-fb54ae619bea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-424448', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7353'] for router, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:54.770086 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c539eeaa-aba7-4332-bdc1-fb54ae619bea admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:54.916777 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c539eeaa-aba7-4332-bdc1-fb54ae619bea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-424459'] for router, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:54.917347 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c539eeaa-aba7-4332-bdc1-fb54ae619bea admin admin] Fanout notify agent at l3_agent the message router_deleted on router 08374e94-6af9-4594-a1ea-925638c38b21 {{(pid=102323) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 17:17:54.923200 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c539eeaa-aba7-4332-bdc1-fb54ae619bea admin admin] Publish callbacks [] for router, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:54.924696 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-c539eeaa-aba7-4332-bdc1-fb54ae619bea admin admin] 10.222.0.16 "DELETE /v2.0/routers/08374e94-6af9-4594-a1ea-925638c38b21 HTTP/1.1" status: 204 len: 168 time: 1.3350368 Nov 11 17:17:54.928482 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 33896) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:54.987610 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_v2 [None req-818dd298-9980-4ee6-a2ba-093074ad91c4 admin admin] Deleting subnet aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4 {{(pid=102324) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:17:54.991357 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-818dd298-9980-4ee6-a2ba-093074ad91c4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:55.028910 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-818dd298-9980-4ee6-a2ba-093074ad91c4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5895837'] for subnet, precommit_delete_associations {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:55.069027 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-818dd298-9980-4ee6-a2ba-093074ad91c4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:55.180106 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-818dd298-9980-4ee6-a2ba-093074ad91c4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5436208', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5275461'] for subnet, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:55.205053 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-818dd298-9980-4ee6-a2ba-093074ad91c4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:55.209140 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-818dd298-9980-4ee6-a2ba-093074ad91c4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:55.212872 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-818dd298-9980-4ee6-a2ba-093074ad91c4 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/aa9ef823-a31d-4cbf-9ee9-9b11d9265fb4 HTTP/1.1" status: 204 len: 168 time: 0.2833047 Nov 11 17:17:55.215668 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 33898) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:55.290666 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c24b31b4-3802-43c7-95ed-539c801ab039 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:55.388059 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c24b31b4-3802-43c7-95ed-539c801ab039 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:55.424320 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-c24b31b4-3802-43c7-95ed-539c801ab039 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['983bda4c-112d-442d-b37a-387818bb1d45']}} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:17:55.429075 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 45f4ef34-f554-4b7d-b2f8-8195d31d3841 no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:17:55.434221 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-c24b31b4-3802-43c7-95ed-539c801ab039 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5eacaa77-ea76-482f-aec2-5adad8f8bde5') {'for_net_delete': True} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:17:55.434515 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-c24b31b4-3802-43c7-95ed-539c801ab039 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5eacaa77-ea76-482f-aec2-5adad8f8bde5') {} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:17:55.444466 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c24b31b4-3802-43c7-95ed-539c801ab039 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5777070'] for segment, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:55.449755 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: 45f4ef34-f554-4b7d-b2f8-8195d31d3841 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:17:55.450103 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 45f4ef34-f554-4b7d-b2f8-8195d31d3841 not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:17:55.450512 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 94af5a65-b91a-4134-9a23-8e8a8229d743 no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:17:55.457811 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c24b31b4-3802-43c7-95ed-539c801ab039 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:55.464705 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c24b31b4-3802-43c7-95ed-539c801ab039 admin admin] Releasing vlan 537 on physical network physnet1 to pool {{(pid=102323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:17:55.465093 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c24b31b4-3802-43c7-95ed-539c801ab039 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5720605'] for segment, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: Traceback (most recent call last): Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: timer() Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: cb(*args, **kw) Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: return func(*args, **kwargs) Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: self._notify() Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: self.callback(batched_events) Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: event.method(event) Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: return f(self, *a, **k) Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._get(url).json() Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: return self.request(url, 'GET', **kwargs) Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:17:55.466794 dv-cinder-694140-2-iscsi neutron-server[102323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:17:55.472508 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: 94af5a65-b91a-4134-9a23-8e8a8229d743 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:17:55.472848 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 94af5a65-b91a-4134-9a23-8e8a8229d743 not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:17:55.607720 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c24b31b4-3802-43c7-95ed-539c801ab039 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:55.618529 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c24b31b4-3802-43c7-95ed-539c801ab039 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:55.622661 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-c24b31b4-3802-43c7-95ed-539c801ab039 admin admin] 10.222.0.16 "DELETE /v2.0/networks/983bda4c-112d-442d-b37a-387818bb1d45 HTTP/1.1" status: 204 len: 168 time: 0.4058230 Nov 11 17:17:55.632343 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c24b31b4-3802-43c7-95ed-539c801ab039 admin admin] Pushing event deleted for resources: {'Network': ['ID=983bda4c-112d-442d-b37a-387818bb1d45,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:56.013982 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 33906) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:56.060640 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-35d5d0b7-6aba-463a-b26b-327267e6e172 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=ed26d137d98846b9b45708f7e581e9b0&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0454333 Nov 11 17:17:56.063235 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 33908) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:56.113060 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bebc53c3-294f-43e6-80af-01b40a556454 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:56.141264 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bebc53c3-294f-43e6-80af-01b40a556454 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:56.276249 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bebc53c3-294f-43e6-80af-01b40a556454 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:56.281009 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bebc53c3-294f-43e6-80af-01b40a556454 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:56.289437 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-bebc53c3-294f-43e6-80af-01b40a556454 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/2ca36acf-90ac-4a6a-b0d5-517cf7449c6b HTTP/1.1" status: 204 len: 168 time: 0.2185700 Nov 11 17:17:56.296063 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bebc53c3-294f-43e6-80af-01b40a556454 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2ca36acf-90ac-4a6a-b0d5-517cf7449c6b,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:57.473440 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 33944) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:57.575877 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-06a61df2-f4f6-4e0e-884b-7fba598a9408 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1075904326-network', 'tenant_id': '7e951c2eae284261a98b317ec84140db'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:17:57.652372 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-06a61df2-f4f6-4e0e-884b-7fba598a9408 admin admin] Made reservation on behalf of 7e951c2eae284261a98b317ec84140db for: {'network': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:17:57.654643 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-06a61df2-f4f6-4e0e-884b-7fba598a9408 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:57.663489 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-06a61df2-f4f6-4e0e-884b-7fba598a9408 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:57.744119 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-06a61df2-f4f6-4e0e-884b-7fba598a9408 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:57.824639 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-06a61df2-f4f6-4e0e-884b-7fba598a9408 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:57.852839 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-06a61df2-f4f6-4e0e-884b-7fba598a9408 admin admin] vlan segment allocate from pool success with {'vlan_id': 544, 'physical_network': 'physnet1'} {{(pid=102323) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:17:57.864286 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06a61df2-f4f6-4e0e-884b-7fba598a9408 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f8e0c9e-8eed-476e-83d2-a5e717672c24,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:57.869246 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-06a61df2-f4f6-4e0e-884b-7fba598a9408 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:57.869588 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.segments_db [None req-06a61df2-f4f6-4e0e-884b-7fba598a9408 admin admin] Added segment 41c0a3f1-0319-4822-972b-4361c6e0b0df of type vlan for network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 Nov 11 17:17:57.911758 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-06a61df2-f4f6-4e0e-884b-7fba598a9408 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:58.019804 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-06a61df2-f4f6-4e0e-884b-7fba598a9408 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:58.021029 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06a61df2-f4f6-4e0e-884b-7fba598a9408 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:58.021888 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-06a61df2-f4f6-4e0e-884b-7fba598a9408 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:58.087506 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06a61df2-f4f6-4e0e-884b-7fba598a9408 admin admin] Pushing event updated for resources: {'Network': ['ID=10ac93d3-f14d-4df5-a044-d683e35c1ab8,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:58.098741 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:17:58.162108 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-06a61df2-f4f6-4e0e-884b-7fba598a9408 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.6873343 Nov 11 17:17:58.168151 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 33954) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:58.175443 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-24025c48-1334-4a69-b384-2754d9a7ab22 admin admin] Request body: {'subnet': {'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1075904326-subnet', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:17:58.287658 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-24025c48-1334-4a69-b384-2754d9a7ab22 admin admin] Made reservation on behalf of 7e951c2eae284261a98b317ec84140db for: {'subnet': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:17:58.290402 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-24025c48-1334-4a69-b384-2754d9a7ab22 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5275488'] for subnet, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:58.528013 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-24025c48-1334-4a69-b384-2754d9a7ab22 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5436401', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5275470'] for subnet, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:58.587305 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24025c48-1334-4a69-b384-2754d9a7ab22 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:58.596598 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24025c48-1334-4a69-b384-2754d9a7ab22 admin admin] Checking segment: {'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:17:58.596953 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24025c48-1334-4a69-b384-2754d9a7ab22 admin admin] Network hostable DHCP agents. Network: 10ac93d3-f14d-4df5-a044-d683e35c1ab8, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:17:58.676268 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24025c48-1334-4a69-b384-2754d9a7ab22 admin admin] Network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:17:58.727359 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-24025c48-1334-4a69-b384-2754d9a7ab22 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, 10ac93d3-f14d-4df5-a044-d683e35c1ab8) {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:17:58.731486 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24025c48-1334-4a69-b384-2754d9a7ab22 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:17:58.732112 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-24025c48-1334-4a69-b384-2754d9a7ab22 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:58.738132 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eec83e09-4ed6-4785-a6bc-a60f5b495011 None None] Network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:17:58.822970 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-24025c48-1334-4a69-b384-2754d9a7ab22 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.6532660 Nov 11 17:17:58.826537 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 33956) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:17:58.831652 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:17:58.892853 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaac6311d-333a-5f5f-a33c-91960009c34a-10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba'}]}} from dv-cinder-694140-2-iscsi. {{(pid=102325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 17:17:58.897259 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:58.916494 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-424378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7339'] for router, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:58.917766 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-424390', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-397156', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7867629', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7328'] for router, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:58.971902 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:59.036241 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.db_base_plugin_common [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Allocated IP 172.20.0.2 (10ac93d3-f14d-4df5-a044-d683e35c1ab8/cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba/a93a01da-484d-42e3-931f-f6e697d1abd5) {{(pid=102325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:17:59.182083 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:59.222790 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Publish callbacks [] for port, precommit_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:59.275642 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624'] for port, after_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:59.321480 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 is already hosted by enough agents. {{(pid=102325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:17:59.324590 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.base_scheduler [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Resources bound (agent type, host, resource id): {{(pid=102325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:17:59.328320 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Received port after_create {{(pid=102325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:17:59.334237 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Pushing event updated for resources: {'Port': ['ID=a93a01da-484d-42e3-931f-f6e697d1abd5,revision_number=1']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:17:59.478388 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:59.505657 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:59.528626 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Attempting to bind port a93a01da-484d-42e3-931f-f6e697d1abd5 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:17:59.528992 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Attempting to bind port a93a01da-484d-42e3-931f-f6e697d1abd5 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:17:59.529356 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Attempting to bind port a93a01da-484d-42e3-931f-f6e697d1abd5 on network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:17:59.536485 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 17, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:17:59.536865 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Checking segment: {'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:17:59.537270 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:59.537660 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Bound using segment: {'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:17:59.538152 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Bound port: a93a01da-484d-42e3-931f-f6e697d1abd5, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:17:59.538530 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:59.609289 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] For port a93a01da-484d-42e3-931f-f6e697d1abd5, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:17:59.612758 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] For port a93a01da-484d-42e3-931f-f6e697d1abd5, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=a93a01da-484d-42e3-931f-f6e697d1abd5,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:17:59.636714 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Allocated IP 172.27.1.141 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/11e3c4be-b19e-49b8-91f8-93740d537aa6) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:17:59.715937 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:59.767292 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:17:59.779793 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d47461d-f29b-420e-b02e-bb52add42eeb None None] Pushing event updated for resources: {'Port': ['ID=a93a01da-484d-42e3-931f-f6e697d1abd5,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:00.219538 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:00.279501 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:18:00.283644 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:18:00.286149 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:18:00.288610 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Pushing event updated for resources: {'Port': ['ID=11e3c4be-b19e-49b8-91f8-93740d537aa6,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:00.621733 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:00.705517 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a600f7a-0947-424d-b7af-739f1f8269f5 None None] Network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:18:00.774395 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-dece6c95-48df-472f-be47-03d5d81da787 None None] Provisioning complete for port a93a01da-484d-42e3-931f-f6e697d1abd5 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:18:00.774789 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-dece6c95-48df-472f-be47-03d5d81da787 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:00.833408 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-424501', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-397235'] for router, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:00.934476 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-dece6c95-48df-472f-be47-03d5d81da787 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:00.976643 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-dece6c95-48df-472f-be47-03d5d81da787 None None] For port a93a01da-484d-42e3-931f-f6e697d1abd5, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=a93a01da-484d-42e3-931f-f6e697d1abd5,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:18:00.984767 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bd41cd7d-a6c1-483e-8c12-ed703805086c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:01.047640 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Router 98cb701e-467a-4425-90db-9dbc5f732760 is scheduled to L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 with binding_index 1 {{(pid=102324) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 17:18:01.104742 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-dece6c95-48df-472f-be47-03d5d81da787 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:01.164055 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dece6c95-48df-472f-be47-03d5d81da787 None None] Pushing event updated for resources: {'Port': ['ID=a93a01da-484d-42e3-931f-f6e697d1abd5,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:01.187837 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:18:01.199542 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Sync routers for ids ['98cb701e-467a-4425-90db-9dbc5f732760'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:18:01.221606 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Routers {'98cb701e-467a-4425-90db-9dbc5f732760'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:18:01.223482 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:17:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['98cb701e-467a-4425-90db-9dbc5f732760'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:01.272845 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] Publish callbacks [] for router, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:01.277444 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-e4ba5321-43e2-4507-9b81-27338e4b6d07 None None] Provisioning complete for port a93a01da-484d-42e3-931f-f6e697d1abd5 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:18:01.277541 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-c62a489d-dffd-4f7f-aa8c-335cc66a6ddb admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.4461019 Nov 11 17:18:01.277621 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-e4ba5321-43e2-4507-9b81-27338e4b6d07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:01.277696 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 33964) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:18:01.331927 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device a93a01da-484d-42e3-931f-f6e697d1abd5 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:18:01.406408 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Set router 98cb701e-467a-4425-90db-9dbc5f732760 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:18:01.554478 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port a93a01da-484d-42e3-931f-f6e697d1abd5 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:18:01.554870 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:01.711037 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:00Z', 'revision_number': 3, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:17:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:01.735044 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:01.738882 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Checking router: 98cb701e-467a-4425-90db-9dbc5f732760 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:18:01.738882 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Updating router 98cb701e-467a-4425-90db-9dbc5f732760 port 11e3c4be-b19e-49b8-91f8-93740d537aa6 binding host dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:18:01.766123 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:01.905217 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Allocated IP 172.20.0.1 (10ac93d3-f14d-4df5-a044-d683e35c1ab8/cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba/f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:18:02.014423 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:02.030717 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Publish callbacks [] for port, precommit_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:02.110220 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:02.127539 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:02.167363 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Attempting to bind port 11e3c4be-b19e-49b8-91f8-93740d537aa6 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:18:02.167729 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Attempting to bind port 11e3c4be-b19e-49b8-91f8-93740d537aa6 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:18:02.168093 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Attempting to bind port 11e3c4be-b19e-49b8-91f8-93740d537aa6 on network 78b17769-6fae-453e-8ae3-4a72e72bccfc {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:18:02.170230 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:18:02.171256 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44d6b6d9-4186-4f17-832d-7c8f9091d5e8 None None] Pushing event updated for resources: {'Port': ['ID=11e3c4be-b19e-49b8-91f8-93740d537aa6,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:02.173807 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:18:02.176057 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 17, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:18:02.176447 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Checking segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:18:02.176635 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:18:02.176826 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:02.177347 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Bound using segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:18:02.177831 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Bound port: 11e3c4be-b19e-49b8-91f8-93740d537aa6, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:18:02.178210 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:02.238490 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Pushing event updated for resources: {'Port': ['ID=f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:02.244340 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] For port 11e3c4be-b19e-49b8-91f8-93740d537aa6, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:18:02.248169 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] For port 11e3c4be-b19e-49b8-91f8-93740d537aa6, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=11e3c4be-b19e-49b8-91f8-93740d537aa6,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:18:02.256155 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-394084'] for router_interface, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:02.311101 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:02.409001 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Routers {'98cb701e-467a-4425-90db-9dbc5f732760'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:18:02.410024 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:17:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['98cb701e-467a-4425-90db-9dbc5f732760'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:02.472677 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44d6b6d9-4186-4f17-832d-7c8f9091d5e8 None None] Pushing event updated for resources: {'Port': ['ID=11e3c4be-b19e-49b8-91f8-93740d537aa6,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:02.526588 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:02.565241 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-1ca1f853-f435-4553-8461-504dad5ff2ed None None] Provisioning complete for port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:18:02.565635 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-1ca1f853-f435-4553-8461-504dad5ff2ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:02.725949 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] Set router 98cb701e-467a-4425-90db-9dbc5f732760 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:18:02.792717 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-e85442cd-a37e-4a3d-87c4-168d00a4a2e8 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:02.794149 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-e85442cd-a37e-4a3d-87c4-168d00a4a2e8 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/networks?id=3f528faa-b7d7-4ae6-81a7-c001fae97f70 HTTP/1.1" status: 200 len: 814 time: 0.1952109 Nov 11 17:18:02.821301 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-1ca1f853-f435-4553-8461-504dad5ff2ed None None] Port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:18:02.830494 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-d5b959b2-95f9-4a5a-9555-14d9e494cd59 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/quotas/1b90b3d6739f4eef8dc3f2a78bb8a043 HTTP/1.1" status: 200 len: 375 time: 0.0216115 Nov 11 17:18:02.832582 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:02.870901 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-fb99ec58-5bb1-4871-ba68-feee67839566 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=1b90b3d6739f4eef8dc3f2a78bb8a043&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0288334 Nov 11 17:18:02.888671 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:02.943759 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:00Z', 'revision_number': 3, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:02.978106 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-524fa8ce-7af4-4016-b8d9-0db767bce90c None None] The sync data for ids ['98cb701e-467a-4425-90db-9dbc5f732760'] in dv-cinder-694140-2-iscsi is: [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:00Z', 'revision_number': 3, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:18:03.014894 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Pushing event updated for resources: {'Port': ['ID=f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:03.020915 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8103788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-394224'] for router_interface, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:03.055844 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-67d2ccd7-c794-49f5-acd4-1fcf9bd25ab5 service neutron] 10.222.0.16 "GET /v2.0/networks/3f528faa-b7d7-4ae6-81a7-c001fae97f70?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1770236 Nov 11 17:18:03.233586 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:18:03.241283 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:18:03.254397 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-c636d7d7-8a8d-4048-b290-781d6b1a40c3 service neutron] 10.222.0.16 "GET /v2.0/networks/3f528faa-b7d7-4ae6-81a7-c001fae97f70?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1910360 Nov 11 17:18:03.472612 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Router 98cb701e-467a-4425-90db-9dbc5f732760 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:18:03.522076 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-a01d015b-ce4d-48d4-ba0d-ac4414743a57 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:03.573554 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-de3c6a7b-befa-40b6-928b-7cc4856d383b None None] Provisioning complete for port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:18:03.573554 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-de3c6a7b-befa-40b6-928b-7cc4856d383b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:03.630356 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-de3c6a7b-befa-40b6-928b-7cc4856d383b None None] Port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:18:03.657315 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:18:03.666618 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-e9a529bd-be74-4762-8cc4-124d3db89c4f admin admin] 10.222.0.16 "PUT /v2.0/routers/98cb701e-467a-4425-90db-9dbc5f732760/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3870516 Nov 11 17:18:03.721523 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-52906ce5-ce2e-4d53-9a7c-eee1f847090b req-8041b6dd-6389-4f12-aff6-4d7dc45a84be tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 210 time: 0.0651989 Nov 11 17:18:04.451206 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 34000) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:18:04.456060 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-7d00ad06-b37a-453c-971f-0355fc3e071d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Request body: {'security_group': {'name': 'tempest-securitygroup--943082079', 'description': 'tempest-description--271748836'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:18:04.603132 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7d00ad06-b37a-453c-971f-0355fc3e071d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:04.603391 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:04.710870 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7d00ad06-b37a-453c-971f-0355fc3e071d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:04.762013 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7d00ad06-b37a-453c-971f-0355fc3e071d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:04.809518 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d00ad06-b37a-453c-971f-0355fc3e071d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event updated for resources: {'SecurityGroup': ['ID=aa8139a3-d43c-45ef-8f8e-58dc577c8c93,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:04.870679 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-67ccd019-6623-4498-95a3-0af3992b7ad5 req-511a7482-017d-46e3-ad85-362197d0d320 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 210 time: 0.0431173 Nov 11 17:18:04.903464 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Sync routers for ids ['98cb701e-467a-4425-90db-9dbc5f732760'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:18:04.908382 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7d00ad06-b37a-453c-971f-0355fc3e071d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:04.910382 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-7d00ad06-b37a-453c-971f-0355fc3e071d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.4577615 Nov 11 17:18:04.913600 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 34004) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:18:04.919034 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Routers {'98cb701e-467a-4425-90db-9dbc5f732760'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:18:04.919998 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:18:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['98cb701e-467a-4425-90db-9dbc5f732760'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:04.920954 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-30a5f472-67e4-4b74-9ee3-5cb4c1fc0a3d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Request body: {'security_group_rule': {'security_group_id': 'aa8139a3-d43c-45ef-8f8e-58dc577c8c93', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:18:05.035364 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-30a5f472-67e4-4b74-9ee3-5cb4c1fc0a3d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:05.046815 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Set router 98cb701e-467a-4425-90db-9dbc5f732760 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:18:05.122219 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-30a5f472-67e4-4b74-9ee3-5cb4c1fc0a3d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:05.206888 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-30a5f472-67e4-4b74-9ee3-5cb4c1fc0a3d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:05.245647 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a5f472-67e4-4b74-9ee3-5cb4c1fc0a3d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=926eecbb-c504-43db-a7e4-98ed8b3bc37f,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:05.331734 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-30a5f472-67e4-4b74-9ee3-5cb4c1fc0a3d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:05.336208 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-30a5f472-67e4-4b74-9ee3-5cb4c1fc0a3d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4179788 Nov 11 17:18:05.336686 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 34006) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:18:05.338316 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 11e3c4be-b19e-49b8-91f8-93740d537aa6 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:18:05.343184 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-5c939e7e-339f-4c81-9e82-0b190d049a32 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Request body: {'security_group_rule': {'security_group_id': 'aa8139a3-d43c-45ef-8f8e-58dc577c8c93', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:18:05.412811 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a', 'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'mac_address': 'fa:16:3e:04:45:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:18:01Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 2, 'project_id': '7e951c2eae284261a98b317ec84140db', 'subnets': [{'id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:05.417472 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 11e3c4be-b19e-49b8-91f8-93740d537aa6 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:18:05.417862 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:05.450048 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Checking router: 98cb701e-467a-4425-90db-9dbc5f732760 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:18:05.450419 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Updating router 98cb701e-467a-4425-90db-9dbc5f732760 port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a binding host dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:18:05.472994 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5c939e7e-339f-4c81-9e82-0b190d049a32 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:05.483358 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:05.530072 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:05.564675 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] For port 11e3c4be-b19e-49b8-91f8-93740d537aa6, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=11e3c4be-b19e-49b8-91f8-93740d537aa6,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:18:05.565599 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5c939e7e-339f-4c81-9e82-0b190d049a32 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:05.630471 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:05.653594 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5c939e7e-339f-4c81-9e82-0b190d049a32 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:05.680859 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c939e7e-339f-4c81-9e82-0b190d049a32 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9db407ab-72a2-4bd6-b6ed-4fa4ccdce4c5,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:05.707060 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Pushing event updated for resources: {'Port': ['ID=11e3c4be-b19e-49b8-91f8-93740d537aa6,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:05.781267 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5c939e7e-339f-4c81-9e82-0b190d049a32 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:05.782857 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-5c939e7e-339f-4c81-9e82-0b190d049a32 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4445598 Nov 11 17:18:05.794056 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 34008) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:18:05.799287 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Request body: {'floatingip': {'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:18:05.875071 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Publish callbacks [] for port, precommit_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:05.902433 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for floatingip, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:05.963533 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:06.001588 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-29771a62-7891-49f9-9297-77577bd78805 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:06.003120 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-29771a62-7891-49f9-9297-77577bd78805 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.10 "GET /v2.0/networks?id=3f528faa-b7d7-4ae6-81a7-c001fae97f70 HTTP/1.1" status: 200 len: 814 time: 0.1690249 Nov 11 17:18:06.022708 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-dfb7f7ba-b379-4496-83d3-30e16b60b90e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Request body: {'port': {'device_id': '50403429-91ff-4288-bb15-d8c8a96d1829', 'network_id': '3f528faa-b7d7-4ae6-81a7-c001fae97f70', 'admin_state_up': True, 'tenant_id': '1b90b3d6739f4eef8dc3f2a78bb8a043'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:18:06.049985 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5306042c-56bd-4d91-a314-f6d50a3e7047 req-2d2115e3-7b1a-4b88-af60-5048fb00310a tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 210 time: 0.0483420 Nov 11 17:18:06.096538 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eece4453-d68b-4c39-a2ee-cf3864065dc6 None None] Pushing event updated for resources: {'Port': ['ID=f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a,revision_number=3']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:06.136660 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eece4453-d68b-4c39-a2ee-cf3864065dc6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:06.137678 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eece4453-d68b-4c39-a2ee-cf3864065dc6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:06.138257 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eece4453-d68b-4c39-a2ee-cf3864065dc6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:06.138710 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eece4453-d68b-4c39-a2ee-cf3864065dc6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:06.139060 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eece4453-d68b-4c39-a2ee-cf3864065dc6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:06.139392 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eece4453-d68b-4c39-a2ee-cf3864065dc6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:06.139727 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eece4453-d68b-4c39-a2ee-cf3864065dc6 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:06.140058 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eece4453-d68b-4c39-a2ee-cf3864065dc6 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:06.140404 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eece4453-d68b-4c39-a2ee-cf3864065dc6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:06.140729 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eece4453-d68b-4c39-a2ee-cf3864065dc6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:06.141079 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eece4453-d68b-4c39-a2ee-cf3864065dc6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:06.141393 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eece4453-d68b-4c39-a2ee-cf3864065dc6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:06.178106 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Attempting to bind port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:18:06.178747 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Attempting to bind port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:18:06.178879 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Attempting to bind port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a on network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:18:06.184146 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:06.187555 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 17, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:18:06.189372 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Checking segment: {'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:18:06.189372 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:06.189372 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Bound using segment: {'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:18:06.189372 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Bound port: f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'}}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:18:06.189735 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:06.290682 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] For port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:18:06.294441 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] For port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:18:06.356422 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Allocated IP 172.27.1.227 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/be4062ef-7812-4821-a5ed-07a1e37ac208) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:18:06.399525 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-c08afb28-0221-4a96-b2ef-7cc53088bad3 None None] Provisioning complete for port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:18:06.400009 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c08afb28-0221-4a96-b2ef-7cc53088bad3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:06.435924 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-dfb7f7ba-b379-4496-83d3-30e16b60b90e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Made reservation on behalf of 1b90b3d6739f4eef8dc3f2a78bb8a043 for: {'port': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:18:06.438761 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:06.439549 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-dfb7f7ba-b379-4496-83d3-30e16b60b90e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:06.464961 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-c08afb28-0221-4a96-b2ef-7cc53088bad3 None None] Port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:18:06.494164 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:06.557392 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:06.572109 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eece4453-d68b-4c39-a2ee-cf3864065dc6 None None] Pushing event updated for resources: {'Port': ['ID=f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a,revision_number=4']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:06.591045 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Routers {'98cb701e-467a-4425-90db-9dbc5f732760'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:18:06.592340 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:18:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['98cb701e-467a-4425-90db-9dbc5f732760'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:06.643253 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-dfb7f7ba-b379-4496-83d3-30e16b60b90e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Allocated IP 172.20.0.6 (3f528faa-b7d7-4ae6-81a7-c001fae97f70/e7b74f8a-11ae-481b-9bec-e05d84a2edc1/a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:18:06.723084 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:06.732209 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] Set router 98cb701e-467a-4425-90db-9dbc5f732760 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:18:06.813521 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:18:06.824656 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:18:06.831020 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:18:06.859738 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event updated for resources: {'Port': ['ID=be4062ef-7812-4821-a5ed-07a1e37ac208,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:06.896613 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-1c81478b-74fa-4a5d-bf52-5cfaf27cb117 None None] Provisioning complete for port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:18:06.897474 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-1c81478b-74fa-4a5d-bf52-5cfaf27cb117 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:06.933160 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-dfb7f7ba-b379-4496-83d3-30e16b60b90e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:06.984360 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a', 'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'mac_address': 'fa:16:3e:04:45:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:18:01Z', 'updated_at': '2021-11-11T17:18:06Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'subnets': [{'id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:07.022761 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:07.029929 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:07.032276 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdc1dd04-214f-4c9a-99f0-d8858d4460e9 None None] The sync data for ids ['98cb701e-467a-4425-90db-9dbc5f732760'] in dv-cinder-694140-2-iscsi is: [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a', 'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'mac_address': 'fa:16:3e:04:45:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:18:01Z', 'updated_at': '2021-11-11T17:18:06Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'subnets': [{'id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:18:07.041168 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-1c81478b-74fa-4a5d-bf52-5cfaf27cb117 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:07.091861 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-1c81478b-74fa-4a5d-bf52-5cfaf27cb117 None None] For port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:18:07.106021 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-dfb7f7ba-b379-4496-83d3-30e16b60b90e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:07.163156 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-1c81478b-74fa-4a5d-bf52-5cfaf27cb117 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:07.188296 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:07.233957 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c81478b-74fa-4a5d-bf52-5cfaf27cb117 None None] Pushing event updated for resources: {'Port': ['ID=f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:07.257307 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-dfb7f7ba-b379-4496-83d3-30e16b60b90e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Network 3f528faa-b7d7-4ae6-81a7-c001fae97f70 is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:18:07.272991 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-dfb7f7ba-b379-4496-83d3-30e16b60b90e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:18:07.289788 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-dfb7f7ba-b379-4496-83d3-30e16b60b90e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:18:07.294528 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfb7f7ba-b379-4496-83d3-30e16b60b90e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Pushing event updated for resources: {'Port': ['ID=a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:07.389202 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:18:07.401526 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed703b4a-9089-43f9-b00b-69b5705d8527 req-c2c1b25c-8b05-4a86-861a-ce64df76cabe tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:07.404173 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ed703b4a-9089-43f9-b00b-69b5705d8527 req-c2c1b25c-8b05-4a86-861a-ce64df76cabe tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 931 time: 0.2476676 Nov 11 17:18:07.430730 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-dfb7f7ba-b379-4496-83d3-30e16b60b90e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:07.431467 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-dfb7f7ba-b379-4496-83d3-30e16b60b90e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:07.456374 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:18:07.457073 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:07.528193 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ed703b4a-9089-43f9-b00b-69b5705d8527 req-d8c4a114-f8ff-4878-8d42-06ff315b0840 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1110847 Nov 11 17:18:07.536675 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-dfb7f7ba-b379-4496-83d3-30e16b60b90e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5223649 Nov 11 17:18:07.550115 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Request body: {'port': {'device_id': '50403429-91ff-4288-bb15-d8c8a96d1829', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:18:07.575615 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 11e3c4be-b19e-49b8-91f8-93740d537aa6 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:18:07.637564 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:07.641180 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:07.653993 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 11e3c4be-b19e-49b8-91f8-93740d537aa6 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:18:07.657240 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:07.706756 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:08.166809 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event updated for resources: {'Port': ['ID=be4062ef-7812-4821-a5ed-07a1e37ac208,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:08.169214 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:08.278836 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:08.280172 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-1dbd70dc-3814-45dd-843f-6b9fd71e003b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.4848325 Nov 11 17:18:08.351052 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 {{(pid=102323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:18:08.358076 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:08.372932 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.provisioning_blocks [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Transition to ACTIVE for port object a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 will not be triggered until provisioned by entity L2. {{(pid=102323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:18:08.466429 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d115ba61-6542-45e7-a914-9952819e7684 req-434b57ae-b030-47b0-9ab5-81ecf40964ee tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-securitygroup--943082079&fields=id&tenant_id=7e951c2eae284261a98b317ec84140db HTTP/1.1" status: 200 len: 267 time: 0.0460291 Nov 11 17:18:08.470404 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:08.529230 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Pushing event updated for resources: {'Port': ['ID=a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:08.592073 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d115ba61-6542-45e7-a914-9952819e7684 req-9799b297-5805-46c7-bbb7-0ca60d2c3618 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:08.593658 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d115ba61-6542-45e7-a914-9952819e7684 req-9799b297-5805-46c7-bbb7-0ca60d2c3618 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/networks?id=10ac93d3-f14d-4df5-a044-d683e35c1ab8 HTTP/1.1" status: 200 len: 811 time: 0.1204588 Nov 11 17:18:08.609670 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Attempting to bind port a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:18:08.609954 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Attempting to bind port a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '92668025-4f51-4378-b7fa-fd59b584fd19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': '3f528faa-b7d7-4ae6-81a7-c001fae97f70'}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:18:08.610227 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Attempting to bind port a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 on network 3f528faa-b7d7-4ae6-81a7-c001fae97f70 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:18:08.615018 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Port a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 on network 3f528faa-b7d7-4ae6-81a7-c001fae97f70 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:18:08.615336 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Attempting to bind port a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 on network 3f528faa-b7d7-4ae6-81a7-c001fae97f70 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:18:08.623182 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d115ba61-6542-45e7-a914-9952819e7684 req-8b72abac-2347-41b1-b5c3-8eb7e5429da8 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/quotas/7e951c2eae284261a98b317ec84140db HTTP/1.1" status: 200 len: 375 time: 0.0145359 Nov 11 17:18:08.630490 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 17, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:18:08.630862 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Checking segment: {'id': '92668025-4f51-4378-b7fa-fd59b584fd19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': '3f528faa-b7d7-4ae6-81a7-c001fae97f70'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:18:08.631228 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Bound using segment: {'id': '92668025-4f51-4378-b7fa-fd59b584fd19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': '3f528faa-b7d7-4ae6-81a7-c001fae97f70'} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:18:08.631676 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Bound port: a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '92668025-4f51-4378-b7fa-fd59b584fd19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': '3f528faa-b7d7-4ae6-81a7-c001fae97f70'}}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:18:08.632032 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:08.677929 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d115ba61-6542-45e7-a914-9952819e7684 req-2cb9b70b-f285-40e9-bc47-cc2cd90e538e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=7e951c2eae284261a98b317ec84140db&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0488226 Nov 11 17:18:08.714810 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d68bbb1-e992-46e6-b819-c211ad7b528d req-3f634ea8-2e05-4e5c-bd6f-a0680ff4447d tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:08.716308 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-3d68bbb1-e992-46e6-b819-c211ad7b528d req-3f634ea8-2e05-4e5c-bd6f-a0680ff4447d tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 943 time: 0.0954754 Nov 11 17:18:08.739277 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] For port a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16, host hv-cinder-69414, cleared binding levels {{(pid=102323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:18:08.766804 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] For port a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16,segment=NetworkSegment(92668025-4f51-4378-b7fa-fd59b584fd19),segment_id=92668025-4f51-4378-b7fa-fd59b584fd19)] {{(pid=102323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:18:08.787746 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d115ba61-6542-45e7-a914-9952819e7684 req-47dbc1b0-e335-49af-b55d-379d01c5b9c3 service neutron] 10.222.0.16 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0960622 Nov 11 17:18:08.795847 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-3d68bbb1-e992-46e6-b819-c211ad7b528d req-6ccdebb4-0c42-4e57-8525-183b449e3071 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0684602 Nov 11 17:18:08.841720 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:08.876343 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:08.877244 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:08.878524 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] 10.222.0.10 "PUT /v2.0/ports/a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 HTTP/1.1" status: 200 len: 1093 time: 1.3331540 Nov 11 17:18:08.880847 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '50403429-91ff-4288-bb15-d8c8a96d1829', 'tag': 'a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:18:08.884382 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9b7932eb-fe43-47a9-9be7-85e8f83aadac" -d '{"events": [{"name": "network-changed", "server_uuid": "50403429-91ff-4288-bb15-d8c8a96d1829", "tag": "a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:18:08.901263 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d115ba61-6542-45e7-a914-9952819e7684 req-d9d574c5-adfd-4dbb-b7b1-b311c46fb52a service neutron] 10.222.0.16 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1046031 Nov 11 17:18:08.914404 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60ded230-73dc-44fb-979c-6aa94d13df04 service neutron] Pushing event updated for resources: {'Port': ['ID=a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16,revision_number=3']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:08.948082 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:18:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-09a6355a-bab9-46e2-afa1-7b43a0abf39d x-openstack-request-id: req-09a6355a-bab9-46e2-afa1-7b43a0abf39d {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:18:08.948373 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "50403429-91ff-4288-bb15-d8c8a96d1829", "tag": "a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:18:08.948626 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-09a6355a-bab9-46e2-afa1-7b43a0abf39d {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:18:08.949023 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '50403429-91ff-4288-bb15-d8c8a96d1829', 'tag': 'a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16', 'status': 'completed', 'code': 200} Nov 11 17:18:09.017732 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b7932eb-fe43-47a9-9be7-85e8f83aadac req-89b7958c-0550-4a9d-bc23-43a8c63be868 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:09.019272 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9b7932eb-fe43-47a9-9be7-85e8f83aadac req-89b7958c-0550-4a9d-bc23-43a8c63be868 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=1b90b3d6739f4eef8dc3f2a78bb8a043&device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 1096 time: 0.0461404 Nov 11 17:18:09.131268 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b7932eb-fe43-47a9-9be7-85e8f83aadac req-53884e97-50f1-42ce-b5c7-bbd2323c16fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:09.132793 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9b7932eb-fe43-47a9-9be7-85e8f83aadac req-53884e97-50f1-42ce-b5c7-bbd2323c16fc service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=1b90b3d6739f4eef8dc3f2a78bb8a043&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1033955 Nov 11 17:18:09.233483 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-3f82ec71-5a3a-4071-8686-cc5b7d7cfc0f req-adeb82f0-aa04-4007-9e8f-555194ef499e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 210 time: 0.0672975 Nov 11 17:18:09.276600 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:18:09.289352 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b7932eb-fe43-47a9-9be7-85e8f83aadac req-f311d050-b391-41a4-93de-d67e6e43bb13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:09.291009 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9b7932eb-fe43-47a9-9be7-85e8f83aadac req-f311d050-b391-41a4-93de-d67e6e43bb13 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1504514 Nov 11 17:18:09.345334 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:18:09.345705 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:09.382412 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-93d6f4d5-c951-4937-bbb4-81bf1ad22a7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:09.384498 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-93d6f4d5-c951-4937-bbb4-81bf1ad22a7d service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=1b90b3d6739f4eef8dc3f2a78bb8a043&device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 1096 time: 0.0459001 Nov 11 17:18:09.432810 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-5d096169-494c-435f-a1a1-be4f50450550 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 HTTP/1.1" status: 200 len: 217 time: 0.0391357 Nov 11 17:18:09.496405 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-4ee4237d-87aa-486a-82d0-762f4b32aed0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:09.497930 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-4ee4237d-87aa-486a-82d0-762f4b32aed0 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=e7b74f8a-11ae-481b-9bec-e05d84a2edc1 HTTP/1.1" status: 200 len: 854 time: 0.0569122 Nov 11 17:18:09.532454 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-39b14212-3be6-42b6-ba69-2d0029109172 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=3f528faa-b7d7-4ae6-81a7-c001fae97f70&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0271261 Nov 11 17:18:09.635491 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-ecf97c49-5ecb-4241-9e03-c32ec289693c service neutron] 10.222.0.10 "GET /v2.0/networks/3f528faa-b7d7-4ae6-81a7-c001fae97f70?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0933056 Nov 11 17:18:09.743726 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d64e5112-52ce-4e81-87a9-07fdf838910a req-8ef49879-69cc-40b6-8c8b-d31c8a3cc11e service neutron] 10.222.0.10 "GET /v2.0/networks/3f528faa-b7d7-4ae6-81a7-c001fae97f70?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1010644 Nov 11 17:18:09.926130 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7611eec-a95c-4ca2-aec2-c97b8d1efeff req-08d7f77f-96f6-4336-b481-c393964081ed tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:09.927603 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d7611eec-a95c-4ca2-aec2-c97b8d1efeff req-08d7f77f-96f6-4336-b481-c393964081ed tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 943 time: 0.0560968 Nov 11 17:18:09.978870 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d7611eec-a95c-4ca2-aec2-c97b8d1efeff req-e7420d90-0692-4384-a981-a8943d9e54b9 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439136 Nov 11 17:18:10.350744 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-231aadaa-7df1-4e33-b56d-10a2cf00bbab req-3d8a9df2-0d0a-4003-9d44-2dfc228f5bcf tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 210 time: 0.0328820 Nov 11 17:18:11.113061 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b98ba14-a975-47c9-8e82-bc45c7386d9a req-160ab7bd-4931-4e87-909b-9a1106993e7f tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:11.114622 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5b98ba14-a975-47c9-8e82-bc45c7386d9a req-160ab7bd-4931-4e87-909b-9a1106993e7f tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 943 time: 0.0515034 Nov 11 17:18:11.164950 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5b98ba14-a975-47c9-8e82-bc45c7386d9a req-a3b4793b-8c0b-48ed-bd40-2eba3d39aa33 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435057 Nov 11 17:18:11.405841 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:18:11.503602 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-98092062-2b74-49b5-8bef-24095d37bed6 req-a733f612-b7f8-4286-9681-fc683a779c55 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 210 time: 0.0752015 Nov 11 17:18:11.507033 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d115ba61-6542-45e7-a914-9952819e7684 req-9478c51a-7335-4278-ac7f-01ca17eec900 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:11.511563 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d115ba61-6542-45e7-a914-9952819e7684 req-9478c51a-7335-4278-ac7f-01ca17eec900 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.10 "GET /v2.0/networks?id=10ac93d3-f14d-4df5-a044-d683e35c1ab8 HTTP/1.1" status: 200 len: 811 time: 0.1750517 Nov 11 17:18:11.553701 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16,segment=NetworkSegment(92668025-4f51-4378-b7fa-fd59b584fd19),segment_id=92668025-4f51-4378-b7fa-fd59b584fd19)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:18:11.569535 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': 'a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16', 'network_id': '3f528faa-b7d7-4ae6-81a7-c001fae97f70', 'port_id': 'a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16', 'mac_address': 'fa:16:3e:a8:9b:e6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 508, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e7b74f8a-11ae-481b-9bec-e05d84a2edc1', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:18:11.590802 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d115ba61-6542-45e7-a914-9952819e7684 req-4a8eb0d4-ef59-40d9-8f72-46a4e4c86797 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=7e951c2eae284261a98b317ec84140db HTTP/1.1" status: 200 len: 379 time: 0.0660405 Nov 11 17:18:11.605674 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-d115ba61-6542-45e7-a914-9952819e7684 req-c12a8e48-d74a-4ee5-8c69-3396996dd54e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Request body: {'port': {'device_id': '59f9c130-2087-4e5f-ad8c-1411737fd8a6', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'admin_state_up': True, 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'security_groups': ['aa8139a3-d43c-45ef-8f8e-58dc577c8c93']}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:18:11.619386 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:11.634591 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:18:11.658245 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16,segment=NetworkSegment(92668025-4f51-4378-b7fa-fd59b584fd19),segment_id=92668025-4f51-4378-b7fa-fd59b584fd19)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:18:11.732562 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:11.788701 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:11.797396 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:11.797769 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:11.798118 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:11.798456 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:11.798843 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:11.799236 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:11.799569 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:11.799948 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:11.800311 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:11.800641 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:11.800968 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:11.801288 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:11.818736 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d115ba61-6542-45e7-a914-9952819e7684 req-c12a8e48-d74a-4ee5-8c69-3396996dd54e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Made reservation on behalf of 7e951c2eae284261a98b317ec84140db for: {'port': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:18:11.825114 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d115ba61-6542-45e7-a914-9952819e7684 req-c12a8e48-d74a-4ee5-8c69-3396996dd54e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:12.002217 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:18:12.014274 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [req-d115ba61-6542-45e7-a914-9952819e7684 req-c12a8e48-d74a-4ee5-8c69-3396996dd54e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Allocated IP 172.20.0.9 (10ac93d3-f14d-4df5-a044-d683e35c1ab8/cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba/ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:18:12.192670 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d115ba61-6542-45e7-a914-9952819e7684 req-c12a8e48-d74a-4ee5-8c69-3396996dd54e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:12.329521 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c4e254d-9ec5-490a-a83b-0d434495581d req-9338d3ed-1fd4-44cc-acec-2d8b8b986c85 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:12.331509 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9c4e254d-9ec5-490a-a83b-0d434495581d req-9338d3ed-1fd4-44cc-acec-2d8b8b986c85 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 944 time: 0.0629156 Nov 11 17:18:12.333193 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d115ba61-6542-45e7-a914-9952819e7684 req-c12a8e48-d74a-4ee5-8c69-3396996dd54e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:12.384402 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d115ba61-6542-45e7-a914-9952819e7684 req-c12a8e48-d74a-4ee5-8c69-3396996dd54e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:18:12.391762 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [req-d115ba61-6542-45e7-a914-9952819e7684 req-c12a8e48-d74a-4ee5-8c69-3396996dd54e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:18:12.396914 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [req-d115ba61-6542-45e7-a914-9952819e7684 req-c12a8e48-d74a-4ee5-8c69-3396996dd54e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:18:12.398190 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9c4e254d-9ec5-490a-a83b-0d434495581d req-b80f7171-2161-4e24-92c4-c1fa4767ed35 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580044 Nov 11 17:18:12.431140 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c12a8e48-d74a-4ee5-8c69-3396996dd54e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event updated for resources: {'Port': ['ID=ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:12.475197 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d115ba61-6542-45e7-a914-9952819e7684 req-c12a8e48-d74a-4ee5-8c69-3396996dd54e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:12.476188 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d115ba61-6542-45e7-a914-9952819e7684 req-c12a8e48-d74a-4ee5-8c69-3396996dd54e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:12.559330 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d115ba61-6542-45e7-a914-9952819e7684 req-c12a8e48-d74a-4ee5-8c69-3396996dd54e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9586625 Nov 11 17:18:12.584173 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Request body: {'port': {'device_id': '59f9c130-2087-4e5f-ad8c-1411737fd8a6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:18:12.693412 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:12.714838 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784b94d8-1590-4e83-b36e-e8c4d5c41c0a req-f30e530e-fb42-4a65-8f7a-16e46ee67b4b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:12.716355 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-784b94d8-1590-4e83-b36e-e8c4d5c41c0a req-f30e530e-fb42-4a65-8f7a-16e46ee67b4b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 931 time: 0.1041865 Nov 11 17:18:12.742064 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-88d2b54b-f2d1-496f-b580-3141b176d6df None None] Provisioning complete for port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:18:12.743458 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-88d2b54b-f2d1-496f-b580-3141b176d6df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:12.782300 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-88d2b54b-f2d1-496f-b580-3141b176d6df None None] Port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:18:12.863624 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-784b94d8-1590-4e83-b36e-e8c4d5c41c0a req-51d44f10-55ec-48b0-bd68-71333ada85b0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1127481 Nov 11 17:18:13.086977 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 {{(pid=102323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:18:13.099172 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:13.113734 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.provisioning_blocks [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Transition to ACTIVE for port object ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 will not be triggered until provisioned by entity L2. {{(pid=102323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:18:13.153487 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9deaa8cc-9112-4e62-aef4-953cb971673f req-2867c670-28fe-4b97-a684-b5ea10cbe6e2 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.3055801 Nov 11 17:18:13.189853 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:13.251939 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9deaa8cc-9112-4e62-aef4-953cb971673f req-d5b90118-3bc3-4fd5-ae1a-c58cddf4aeb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:13.253966 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9deaa8cc-9112-4e62-aef4-953cb971673f req-d5b90118-3bc3-4fd5-ae1a-c58cddf4aeb6 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=3a6e5bdc578b460ab28a883efa598f95&device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 1100 time: 0.0501785 Nov 11 17:18:13.267890 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Pushing event updated for resources: {'Port': ['ID=ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:13.378280 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Attempting to bind port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:18:13.379002 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Attempting to bind port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:18:13.380133 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Attempting to bind port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 on network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:18:13.386163 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 on network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:18:13.386900 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Attempting to bind port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 on network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:18:13.394085 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 17, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:18:13.395135 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Checking segment: {'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:18:13.397884 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Bound using segment: {'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:18:13.397884 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Bound port: ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'}}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:18:13.397884 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:13.400893 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9deaa8cc-9112-4e62-aef4-953cb971673f req-a61b17d3-efa6-4a2f-8cdf-bb58675c78d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:13.403203 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9deaa8cc-9112-4e62-aef4-953cb971673f req-a61b17d3-efa6-4a2f-8cdf-bb58675c78d9 service neutron] 10.222.0.10 "GET /v2.0/networks?id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f HTTP/1.1" status: 200 len: 917 time: 0.1130266 Nov 11 17:18:13.420087 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:18:13.525123 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] For port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8, host hv-cinder-69414, cleared binding levels {{(pid=102323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:18:13.528308 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] For port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:18:13.565657 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9deaa8cc-9112-4e62-aef4-953cb971673f req-e6746394-369d-49a3-ad7d-e81474c3b6ab service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5de5065e-0ad8-4180-bd18-4e9927716a88 HTTP/1.1" status: 200 len: 1002 time: 0.1528060 Nov 11 17:18:13.612620 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eb02e3c-73f0-4adb-8b81-0b5058185162 req-6ef85756-fc87-457e-ba2c-ee910b7717a5 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:13.614733 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4257f6fc-ef29-4e98-91dd-a6c6ca700c6b req-417a1a1b-9692-4b3b-a221-915d71f528b0 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:13.615194 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1eb02e3c-73f0-4adb-8b81-0b5058185162 req-6ef85756-fc87-457e-ba2c-ee910b7717a5 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 947 time: 0.0843079 Nov 11 17:18:13.616285 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4257f6fc-ef29-4e98-91dd-a6c6ca700c6b req-417a1a1b-9692-4b3b-a221-915d71f528b0 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 944 time: 0.0844831 Nov 11 17:18:13.618089 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:13.636291 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:18:13.641506 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:18:13.642179 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:13.647471 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9deaa8cc-9112-4e62-aef4-953cb971673f req-4d306cab-b7ac-440d-a033-2dbb3137ddac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:13.649517 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9deaa8cc-9112-4e62-aef4-953cb971673f req-4d306cab-b7ac-440d-a033-2dbb3137ddac service neutron] 10.222.0.10 "GET /v2.0/subnets?id=1a4b11d7-2160-49c3-be78-265f0700c580 HTTP/1.1" status: 200 len: 855 time: 0.0747385 Nov 11 17:18:13.676994 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:13.677635 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:13.679085 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d115ba61-6542-45e7-a914-9952819e7684 req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] 10.222.0.10 "PUT /v2.0/ports/ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 HTTP/1.1" status: 200 len: 1093 time: 1.1030786 Nov 11 17:18:13.685477 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '59f9c130-2087-4e5f-ad8c-1411737fd8a6', 'tag': 'ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:18:13.687888 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-928195f0-c5de-4ad3-8b51-ec279d70e0ea" -d '{"events": [{"name": "network-changed", "server_uuid": "59f9c130-2087-4e5f-ad8c-1411737fd8a6", "tag": "ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:18:13.715770 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4257f6fc-ef29-4e98-91dd-a6c6ca700c6b req-70106ec7-9c09-4af9-9c6a-488e57f0a815 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0903573 Nov 11 17:18:13.744294 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9deaa8cc-9112-4e62-aef4-953cb971673f req-52f75927-6340-42ae-b082-e79204945cc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:13.745762 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9deaa8cc-9112-4e62-aef4-953cb971673f req-52f75927-6340-42ae-b082-e79204945cc9 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0879974 Nov 11 17:18:13.805836 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:13.827187 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1eb02e3c-73f0-4adb-8b81-0b5058185162 req-f1aafbdb-6e58-4d4f-a34b-93047b77daa7 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1986187 Nov 11 17:18:13.832515 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:18:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-66ac02de-bcdf-475f-889a-8ab9b1f7b767 x-openstack-request-id: req-66ac02de-bcdf-475f-889a-8ab9b1f7b767 {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:18:13.832808 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "59f9c130-2087-4e5f-ad8c-1411737fd8a6", "tag": "ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:18:13.833060 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-66ac02de-bcdf-475f-889a-8ab9b1f7b767 {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:18:13.834061 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '59f9c130-2087-4e5f-ad8c-1411737fd8a6', 'tag': 'ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8', 'status': 'completed', 'code': 200} Nov 11 17:18:13.835584 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-524ba58c-3623-4711-b51c-23fd8157fb93 service neutron] Pushing event updated for resources: {'Port': ['ID=ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8,revision_number=3']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:13.849424 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '50403429-91ff-4288-bb15-d8c8a96d1829', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:18:13.855415 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0e7331ac-4a8b-459b-a113-c183468b9b84" -d '{"events": [{"server_uuid": "50403429-91ff-4288-bb15-d8c8a96d1829", "name": "network-vif-plugged", "status": "completed", "tag": "a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:18:13.884779 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16,segment=NetworkSegment(92668025-4f51-4378-b7fa-fd59b584fd19),segment_id=92668025-4f51-4378-b7fa-fd59b584fd19)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:18:13.908028 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:18:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b1fdecf9-2685-4904-81e9-e9d8fe22449b x-openstack-request-id: req-b1fdecf9-2685-4904-81e9-e9d8fe22449b {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:18:13.908491 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "50403429-91ff-4288-bb15-d8c8a96d1829", "name": "network-vif-plugged", "status": "completed", "tag": "a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:18:13.908610 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-928195f0-c5de-4ad3-8b51-ec279d70e0ea req-c508d3d4-f83f-42b3-ba0e-30b7bb2be67b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:13.908878 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-b1fdecf9-2685-4904-81e9-e9d8fe22449b {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:18:13.909344 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '50403429-91ff-4288-bb15-d8c8a96d1829', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16', 'code': 200} Nov 11 17:18:13.911194 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-928195f0-c5de-4ad3-8b51-ec279d70e0ea req-c508d3d4-f83f-42b3-ba0e-30b7bb2be67b service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=7e951c2eae284261a98b317ec84140db&device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 1096 time: 0.0768049 Nov 11 17:18:13.944141 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9deaa8cc-9112-4e62-aef4-953cb971673f req-04fc4d98-b0a8-4376-968c-2b232d950ad6 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1891813 Nov 11 17:18:13.955803 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:14.026334 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:14.092826 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ea36d5-c595-4570-a9b3-802ef63a81ad req-3689f5a3-4ad9-4416-aa74-4b0859b20f14 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:14.098573 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a4ea36d5-c595-4570-a9b3-802ef63a81ad req-3689f5a3-4ad9-4416-aa74-4b0859b20f14 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 943 time: 0.0840507 Nov 11 17:18:14.098573 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-928195f0-c5de-4ad3-8b51-ec279d70e0ea req-237ecaff-d4d1-4b4b-bfeb-f5591cabf49c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:14.098573 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-928195f0-c5de-4ad3-8b51-ec279d70e0ea req-237ecaff-d4d1-4b4b-bfeb-f5591cabf49c service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=7e951c2eae284261a98b317ec84140db&shared=False HTTP/1.1" status: 200 len: 912 time: 0.1602283 Nov 11 17:18:14.107618 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9deaa8cc-9112-4e62-aef4-953cb971673f req-d2c7f880-bb79-44a4-9ccb-5b0851f21ed5 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1440606 Nov 11 17:18:14.216989 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a4ea36d5-c595-4570-a9b3-802ef63a81ad req-8ec1c60a-f09d-48b7-8102-55ceb3a82abd tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1108944 Nov 11 17:18:14.260567 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-928195f0-c5de-4ad3-8b51-ec279d70e0ea req-50351664-2280-4b42-b775-aeda198f6399 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:14.264332 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-928195f0-c5de-4ad3-8b51-ec279d70e0ea req-50351664-2280-4b42-b775-aeda198f6399 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1460209 Nov 11 17:18:14.277400 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24014571-91eb-451b-8ea0-decb014714c6 req-ec80c3c5-3968-4b7c-9e36-b32afba4577d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:14.278977 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-24014571-91eb-451b-8ea0-decb014714c6 req-ec80c3c5-3968-4b7c-9e36-b32afba4577d service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 1098 time: 0.0649529 Nov 11 17:18:14.345174 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-24014571-91eb-451b-8ea0-decb014714c6 req-735f2900-a7f4-4397-95ad-671a0da50229 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539885 Nov 11 17:18:14.384919 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d115ba61-6542-45e7-a914-9952819e7684 req-3f75d16a-858f-49c7-a01d-70e38c1d5049 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:14.387306 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d115ba61-6542-45e7-a914-9952819e7684 req-3f75d16a-858f-49c7-a01d-70e38c1d5049 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=7e951c2eae284261a98b317ec84140db&device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 1096 time: 0.0719855 Nov 11 17:18:14.591793 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d115ba61-6542-45e7-a914-9952819e7684 req-96fdb881-3901-4c36-ad68-4267a5452126 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 HTTP/1.1" status: 200 len: 217 time: 0.0377769 Nov 11 17:18:14.646947 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d115ba61-6542-45e7-a914-9952819e7684 req-9b429316-42bf-4302-a0bb-0e9a2b4cc144 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:14.648340 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d115ba61-6542-45e7-a914-9952819e7684 req-9b429316-42bf-4302-a0bb-0e9a2b4cc144 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba HTTP/1.1" status: 200 len: 850 time: 0.0476241 Nov 11 17:18:14.723131 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d115ba61-6542-45e7-a914-9952819e7684 req-9ee8cc11-530b-4e0d-8faa-f5f9cbc29d13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:14.724971 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d115ba61-6542-45e7-a914-9952819e7684 req-9ee8cc11-530b-4e0d-8faa-f5f9cbc29d13 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=10ac93d3-f14d-4df5-a044-d683e35c1ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0687971 Nov 11 17:18:14.843471 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d115ba61-6542-45e7-a914-9952819e7684 req-42cba7a9-4f1a-496f-99aa-f4e3363064de service neutron] 10.222.0.10 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1058047 Nov 11 17:18:14.893840 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a534451-dc18-4ec7-97b5-c2c46247505d req-f50d7afa-97bd-4cd0-bc31-1451511b0687 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:14.896514 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9a534451-dc18-4ec7-97b5-c2c46247505d req-f50d7afa-97bd-4cd0-bc31-1451511b0687 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 945 time: 0.0860772 Nov 11 17:18:14.964563 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9a534451-dc18-4ec7-97b5-c2c46247505d req-3376f6ce-bbcb-405d-bef6-e6678cded74a tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0597918 Nov 11 17:18:14.981585 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d115ba61-6542-45e7-a914-9952819e7684 req-9fef8f17-188b-449f-86a4-fa1400039366 service neutron] 10.222.0.10 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1301448 Nov 11 17:18:15.025124 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45dbe752-ca72-46cd-b1b3-b39c5cead5f3 req-b6aea869-bd6e-4132-b64a-e12aa719c84a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:15.026765 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-45dbe752-ca72-46cd-b1b3-b39c5cead5f3 req-b6aea869-bd6e-4132-b64a-e12aa719c84a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 947 time: 0.0588233 Nov 11 17:18:15.093716 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-45dbe752-ca72-46cd-b1b3-b39c5cead5f3 req-2d0d46d6-313f-4009-97d1-a11a653c98a6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0606418 Nov 11 17:18:15.345129 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a5fe54b-3af1-4261-90e1-bbbd4a134142 req-d20d97f9-c04b-47dc-893e-31193efba2e2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:15.346688 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4a5fe54b-3af1-4261-90e1-bbbd4a134142 req-d20d97f9-c04b-47dc-893e-31193efba2e2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 943 time: 0.0546267 Nov 11 17:18:15.404704 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4a5fe54b-3af1-4261-90e1-bbbd4a134142 req-becf0222-d14b-43c1-8b6b-05efcd773a87 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464799 Nov 11 17:18:15.675938 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-918a0b98-802c-4f46-8dd6-040a545fd50e req-45b0751c-517b-41d2-bbf9-5e2c506a6ed0 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:15.677672 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-918a0b98-802c-4f46-8dd6-040a545fd50e req-45b0751c-517b-41d2-bbf9-5e2c506a6ed0 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.10 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 947 time: 0.0587966 Nov 11 17:18:15.776553 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [req-918a0b98-802c-4f46-8dd6-040a545fd50e req-980c3a3f-bbaa-4eda-8a36-784e587fb600 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Deleting port 5de5065e-0ad8-4180-bd18-4e9927716a88 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:18:15.776553 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-918a0b98-802c-4f46-8dd6-040a545fd50e req-980c3a3f-bbaa-4eda-8a36-784e587fb600 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:15.902738 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-918a0b98-802c-4f46-8dd6-040a545fd50e req-980c3a3f-bbaa-4eda-8a36-784e587fb600 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] For port 5de5065e-0ad8-4180-bd18-4e9927716a88, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5de5065e-0ad8-4180-bd18-4e9927716a88,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:18:15.903333 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-918a0b98-802c-4f46-8dd6-040a545fd50e req-980c3a3f-bbaa-4eda-8a36-784e587fb600 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:16.185525 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b07a3d3-b436-4554-8311-980e998f3cf8 req-aec7f3a2-4cc9-4094-9c46-3bcbd2adea7f tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:16.187106 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8b07a3d3-b436-4554-8311-980e998f3cf8 req-aec7f3a2-4cc9-4094-9c46-3bcbd2adea7f tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 945 time: 0.1330159 Nov 11 17:18:16.225255 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-918a0b98-802c-4f46-8dd6-040a545fd50e req-980c3a3f-bbaa-4eda-8a36-784e587fb600 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:16.225621 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-918a0b98-802c-4f46-8dd6-040a545fd50e req-980c3a3f-bbaa-4eda-8a36-784e587fb600 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:16.225969 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.l3_db [req-918a0b98-802c-4f46-8dd6-040a545fd50e req-980c3a3f-bbaa-4eda-8a36-784e587fb600 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Floating IP 1ca39191-b1b7-4ab8-b6d1-609e6da1fb0f disassociated. External IP: 172.27.1.197, port: 5de5065e-0ad8-4180-bd18-4e9927716a88. Nov 11 17:18:16.226285 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [req-918a0b98-802c-4f46-8dd6-040a545fd50e req-980c3a3f-bbaa-4eda-8a36-784e587fb600 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Calling delete_port for 5de5065e-0ad8-4180-bd18-4e9927716a88 owned by compute:nova {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:18:16.239582 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dae55d2b-76e4-40f0-8e25-098eefccb17a req-3d944e36-9211-4f26-81f5-16c4d0f01936 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:16.241157 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dae55d2b-76e4-40f0-8e25-098eefccb17a req-3d944e36-9211-4f26-81f5-16c4d0f01936 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 947 time: 0.0589619 Nov 11 17:18:16.312004 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dae55d2b-76e4-40f0-8e25-098eefccb17a req-608989f1-aa32-4db4-ada5-d29f0dc96d29 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=0acab519-6858-46d7-8130-5f8ede58987f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0631576 Nov 11 17:18:16.353392 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8b07a3d3-b436-4554-8311-980e998f3cf8 req-36d09d2f-6aad-4cb8-9dfc-ac19f1eb0b7d tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1542473 Nov 11 17:18:16.577332 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-918a0b98-802c-4f46-8dd6-040a545fd50e req-980c3a3f-bbaa-4eda-8a36-784e587fb600 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:16.622221 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-753c5f6c-e9d0-4b6d-a696-715fec8726f8 req-3f46d209-1719-4d4c-a6b0-477e0cc7d6d8 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:16.623852 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-753c5f6c-e9d0-4b6d-a696-715fec8726f8 req-3f46d209-1719-4d4c-a6b0-477e0cc7d6d8 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 943 time: 0.0945103 Nov 11 17:18:16.626840 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-980c3a3f-bbaa-4eda-8a36-784e587fb600 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event deleted for resources: {'Port': ['ID=5de5065e-0ad8-4180-bd18-4e9927716a88,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:16.760225 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-753c5f6c-e9d0-4b6d-a696-715fec8726f8 req-1248e6d6-e4d1-4093-b884-eb48c1e28d0f tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1240520 Nov 11 17:18:16.796511 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [req-918a0b98-802c-4f46-8dd6-040a545fd50e req-980c3a3f-bbaa-4eda-8a36-784e587fb600 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Router 1a70d97d-215a-45d3-ba2b-b538e79a3278 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:18:16.858520 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:16.959517 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-918a0b98-802c-4f46-8dd6-040a545fd50e req-980c3a3f-bbaa-4eda-8a36-784e587fb600 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:18:16.976146 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f917b33-1d72-48d7-a70f-7cd5ff472df1 None None] Sync routers for ids ['1a70d97d-215a-45d3-ba2b-b538e79a3278'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:18:16.994954 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f917b33-1d72-48d7-a70f-7cd5ff472df1 None None] Routers {'1a70d97d-215a-45d3-ba2b-b538e79a3278'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:18:16.996099 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-0f917b33-1d72-48d7-a70f-7cd5ff472df1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:18:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1a70d97d-215a-45d3-ba2b-b538e79a3278'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:17.009307 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [req-918a0b98-802c-4f46-8dd6-040a545fd50e req-980c3a3f-bbaa-4eda-8a36-784e587fb600 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] No DVR routers for this DVR port 5de5065e-0ad8-4180-bd18-4e9927716a88 on host hv-cinder-69414 {{(pid=102323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:18:17.012168 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-918a0b98-802c-4f46-8dd6-040a545fd50e req-980c3a3f-bbaa-4eda-8a36-784e587fb600 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:17.015798 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-918a0b98-802c-4f46-8dd6-040a545fd50e req-980c3a3f-bbaa-4eda-8a36-784e587fb600 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.10 "DELETE /v2.0/ports/5de5065e-0ad8-4180-bd18-4e9927716a88 HTTP/1.1" status: 204 len: 173 time: 1.3302937 Nov 11 17:18:17.016298 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '51c0e58c-1427-425f-ba26-73999c61ac11', 'name': 'network-vif-deleted', 'tag': '5de5065e-0ad8-4180-bd18-4e9927716a88'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:18:17.019327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee589599-3296-41ad-9f2d-eb276791c30f" -d '{"events": [{"server_uuid": "51c0e58c-1427-425f-ba26-73999c61ac11", "name": "network-vif-deleted", "tag": "5de5065e-0ad8-4180-bd18-4e9927716a88"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:18:17.082813 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:18:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8e118fb6-b99d-4522-8c83-8233ad9cb860 x-openstack-request-id: req-8e118fb6-b99d-4522-8c83-8233ad9cb860 {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:18:17.083236 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "51c0e58c-1427-425f-ba26-73999c61ac11", "name": "network-vif-deleted", "tag": "5de5065e-0ad8-4180-bd18-4e9927716a88", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:18:17.083819 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-8e118fb6-b99d-4522-8c83-8233ad9cb860 {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:18:17.084444 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '51c0e58c-1427-425f-ba26-73999c61ac11', 'name': 'network-vif-deleted', 'tag': '5de5065e-0ad8-4180-bd18-4e9927716a88', 'status': 'completed', 'code': 200} Nov 11 17:18:17.167282 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-0f917b33-1d72-48d7-a70f-7cd5ff472df1 None None] Set router 1a70d97d-215a-45d3-ba2b-b538e79a3278 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:18:17.435053 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:18:17.488393 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-0f917b33-1d72-48d7-a70f-7cd5ff472df1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'aa2fc75b-4ee8-4417-b781-eb1c551f1c43', 'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'mac_address': 'fa:16:3e:61:80:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:15Z', 'updated_at': '2021-11-11T17:14:22Z', 'revision_number': 5, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'subnets': [{'id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:17.544020 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f917b33-1d72-48d7-a70f-7cd5ff472df1 None None] Checking router: 1a70d97d-215a-45d3-ba2b-b538e79a3278 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:18:17.552237 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-af8e3049-55ad-4328-9bd4-05c79b0e45d2 req-ea13aa37-a1c3-4fde-b96c-34629b9de9e1 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=51c0e58c-1427-425f-ba26-73999c61ac11 HTTP/1.1" status: 200 len: 210 time: 0.0329945 Nov 11 17:18:17.597186 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f917b33-1d72-48d7-a70f-7cd5ff472df1 None None] Routers {'1a70d97d-215a-45d3-ba2b-b538e79a3278'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:18:17.597850 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-0f917b33-1d72-48d7-a70f-7cd5ff472df1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:18:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1a70d97d-215a-45d3-ba2b-b538e79a3278'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:17.953125 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cad13216-d80a-42b2-9af4-02dce701b9e6 req-f62c4639-3435-4e6a-83ce-eb47d5cfc0f1 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:17.956709 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cad13216-d80a-42b2-9af4-02dce701b9e6 req-f62c4639-3435-4e6a-83ce-eb47d5cfc0f1 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 943 time: 0.0720730 Nov 11 17:18:18.020360 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-0f917b33-1d72-48d7-a70f-7cd5ff472df1 None None] Set router 1a70d97d-215a-45d3-ba2b-b538e79a3278 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:18:18.069163 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cad13216-d80a-42b2-9af4-02dce701b9e6 req-b604ad4b-f06c-4e39-be6c-839f59d4cc9d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0984917 Nov 11 17:18:18.108617 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:18:18.156293 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': 'ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'port_id': 'ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8', 'mac_address': 'fa:16:3e:00:f4:1f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 544, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:18:18.337649 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:18.364805 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:18:18.400775 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:18:18.468141 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-0f917b33-1d72-48d7-a70f-7cd5ff472df1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'aa2fc75b-4ee8-4417-b781-eb1c551f1c43', 'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'mac_address': 'fa:16:3e:61:80:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:15Z', 'updated_at': '2021-11-11T17:14:22Z', 'revision_number': 5, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'subnets': [{'id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:18.499599 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f917b33-1d72-48d7-a70f-7cd5ff472df1 None None] The sync data for ids ['1a70d97d-215a-45d3-ba2b-b538e79a3278'] in dv-cinder-694140-2-iscsi is: [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'aa2fc75b-4ee8-4417-b781-eb1c551f1c43', 'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'mac_address': 'fa:16:3e:61:80:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:15Z', 'updated_at': '2021-11-11T17:14:22Z', 'revision_number': 5, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'subnets': [{'id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:18:18.501846 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:18.590189 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:18.822804 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:18:18.825331 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 34130) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:18:18.898116 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f3fb0427-d00f-41b9-a253-143ccc065ca6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:18.935124 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-195dbaf9-c688-408e-a5fe-37bcf42855a8 None None] New status for floating IP 1ca39191-b1b7-4ab8-b6d1-609e6da1fb0f: DOWN {{(pid=102326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:18:18.945129 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f3fb0427-d00f-41b9-a253-143ccc065ca6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:19.120635 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f3fb0427-d00f-41b9-a253-143ccc065ca6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:19.123301 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f3fb0427-d00f-41b9-a253-143ccc065ca6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:19.127570 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-f3fb0427-d00f-41b9-a253-143ccc065ca6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "DELETE /v2.0/security-groups/0acab519-6858-46d7-8130-5f8ede58987f HTTP/1.1" status: 204 len: 168 time: 0.3308442 Nov 11 17:18:19.128858 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 34134) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:18:19.143333 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3fb0427-d00f-41b9-a253-143ccc065ca6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0acab519-6858-46d7-8130-5f8ede58987f,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:19.150648 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.api.v2.resource [None req-7cefec86-f3d7-4240-bd32-ec38760491c5 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] show failed (client error): The resource could not be found. Nov 11 17:18:19.152126 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-7cefec86-f3d7-4240-bd32-ec38760491c5 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups/0acab519-6858-46d7-8130-5f8ede58987f HTTP/1.1" status: 404 len: 347 time: 0.0221436 Nov 11 17:18:19.157367 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 34136) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:18:19.306643 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbe8c29c-0ee9-4fba-a935-a4a3bae2b0a4 req-f4b4b50b-1a88-4c8f-86b5-9332dfb771f0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:19.308235 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fbe8c29c-0ee9-4fba-a935-a4a3bae2b0a4 req-f4b4b50b-1a88-4c8f-86b5-9332dfb771f0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 944 time: 0.1119277 Nov 11 17:18:19.369502 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-1c43d86f-3535-4326-892d-25dbcaa1e587 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Deleting port 0fbd8885-6c03-4cfd-afb2-e1b3bcc53845 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:18:19.369746 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1c43d86f-3535-4326-892d-25dbcaa1e587 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:19.376447 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fbe8c29c-0ee9-4fba-a935-a4a3bae2b0a4 req-7fe51ccf-a3e3-4b92-83b2-77edcc6eabfb tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0614150 Nov 11 17:18:19.422019 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 5de5065e-0ad8-4180-bd18-4e9927716a88 no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:18:19.461435 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: 5de5065e-0ad8-4180-bd18-4e9927716a88 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:18:19.462011 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 5de5065e-0ad8-4180-bd18-4e9927716a88 not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:18:19.733514 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1c43d86f-3535-4326-892d-25dbcaa1e587 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:19.734130 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1c43d86f-3535-4326-892d-25dbcaa1e587 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:19.749194 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-1c43d86f-3535-4326-892d-25dbcaa1e587 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Calling delete_port for 0fbd8885-6c03-4cfd-afb2-e1b3bcc53845 owned by network:floatingip {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:18:19.989805 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1c43d86f-3535-4326-892d-25dbcaa1e587 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:20.015916 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c43d86f-3535-4326-892d-25dbcaa1e587 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event deleted for resources: {'Port': ['ID=0fbd8885-6c03-4cfd-afb2-e1b3bcc53845,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:20.080493 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1c43d86f-3535-4326-892d-25dbcaa1e587 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for floatingip, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:20.083091 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1c43d86f-3535-4326-892d-25dbcaa1e587 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:20.084231 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-1c43d86f-3535-4326-892d-25dbcaa1e587 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "DELETE /v2.0/floatingips/1ca39191-b1b7-4ab8-b6d1-609e6da1fb0f HTTP/1.1" status: 204 len: 168 time: 0.9258986 Nov 11 17:18:20.500301 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b0bef5a-bb1b-4179-af67-2b4de7592ea3 req-c405c36d-03a0-46ac-be85-80c533768612 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:20.501857 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4b0bef5a-bb1b-4179-af67-2b4de7592ea3 req-c405c36d-03a0-46ac-be85-80c533768612 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 944 time: 0.0521269 Nov 11 17:18:20.513211 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 34144) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:18:20.521161 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Request body: {'security_group': {'name': 'tempest-securitygroup--445292402', 'description': 'tempest-description--966438869'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:18:20.556966 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4b0bef5a-bb1b-4179-af67-2b4de7592ea3 req-49b6d1bd-57d7-45e6-bfdf-6539cdd053c8 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436614 Nov 11 17:18:20.629488 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:20.714733 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:20.777936 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:20.807354 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event updated for resources: {'SecurityGroup': ['ID=438d3606-b70e-495a-a217-7f77d339ec4f,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:20.815288 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:20.815628 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:20.815970 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:20.816307 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:20.816695 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:20.818779 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:20.818779 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:20.818779 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:20.818779 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:20.818779 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:20.818779 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:20.819528 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:18:20.882689 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:20.884315 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-0146a66d-1137-4fc4-97f6-ce6f95d1a135 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.3692329 Nov 11 17:18:20.886955 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 34148) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:18:20.891588 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-ca1b7ec9-b000-4403-8893-202030dbe54a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Request body: {'security_group_rule': {'security_group_id': '438d3606-b70e-495a-a217-7f77d339ec4f', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:18:21.001179 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ca1b7ec9-b000-4403-8893-202030dbe54a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:21.063934 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ca1b7ec9-b000-4403-8893-202030dbe54a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:21.137942 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ca1b7ec9-b000-4403-8893-202030dbe54a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:21.141073 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:18:21.158058 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca1b7ec9-b000-4403-8893-202030dbe54a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6edfca1e-ea9e-48a5-a5d6-e5be31d78e3d,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:21.214166 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-ca1b7ec9-b000-4403-8893-202030dbe54a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:21.215572 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-ca1b7ec9-b000-4403-8893-202030dbe54a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3276422 Nov 11 17:18:21.218304 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 34150) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:18:21.222884 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-e4bb04f0-26d6-4a18-bbe1-b7f447992150 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Request body: {'security_group_rule': {'security_group_id': '438d3606-b70e-495a-a217-7f77d339ec4f', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:18:21.309907 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e4bb04f0-26d6-4a18-bbe1-b7f447992150 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:21.368030 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e4bb04f0-26d6-4a18-bbe1-b7f447992150 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:21.419261 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:18:21.440803 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e4bb04f0-26d6-4a18-bbe1-b7f447992150 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:21.458786 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4bb04f0-26d6-4a18-bbe1-b7f447992150 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5769800e-2670-4e6b-a5a0-d1293c93b4b0,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:21.534324 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e4bb04f0-26d6-4a18-bbe1-b7f447992150 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:21.535635 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-e4bb04f0-26d6-4a18-bbe1-b7f447992150 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3163364 Nov 11 17:18:21.537978 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:18:21.538717 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 34152) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:18:21.542938 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:18:21.543323 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:21.544071 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Request body: {'floatingip': {'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:18:21.631276 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:21.647424 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for floatingip, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:21.657985 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '59f9c130-2087-4e5f-ad8c-1411737fd8a6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:18:21.660444 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ba4937b9-d0f2-4e0e-963f-cdc21fa76f64" -d '{"events": [{"server_uuid": "59f9c130-2087-4e5f-ad8c-1411737fd8a6", "name": "network-vif-plugged", "status": "completed", "tag": "ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:18:21.679018 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:18:21.704209 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:18:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-522a8d3e-39cb-4192-9be4-328cea8c1305 x-openstack-request-id: req-522a8d3e-39cb-4192-9be4-328cea8c1305 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:18:21.704520 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "59f9c130-2087-4e5f-ad8c-1411737fd8a6", "name": "network-vif-plugged", "status": "completed", "tag": "ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:18:21.704794 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-522a8d3e-39cb-4192-9be4-328cea8c1305 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:18:21.705195 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '59f9c130-2087-4e5f-ad8c-1411737fd8a6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8', 'code': 200} Nov 11 17:18:21.743531 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:21.747496 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf5eaf88-de7f-488f-9d1c-d07e3c5cdb49 req-16b20f2e-117e-4fb7-84eb-3a7c09a815ac tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:21.749048 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bf5eaf88-de7f-488f-9d1c-d07e3c5cdb49 req-16b20f2e-117e-4fb7-84eb-3a7c09a815ac tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 944 time: 0.1117985 Nov 11 17:18:21.799904 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:21.815740 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bf5eaf88-de7f-488f-9d1c-d07e3c5cdb49 req-160fa743-5b4f-4cba-917a-119873aa50d8 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0564587 Nov 11 17:18:21.841322 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:21.953646 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Allocated IP 172.27.1.64 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/b300149d-6b5d-4954-a7d9-daf56ede73a9) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:18:22.021726 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afea2fca-5218-4649-b38e-7f20dddf8b6b req-ab8470fb-5573-4916-91a7-2220a0c56afc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:22.023271 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-afea2fca-5218-4649-b38e-7f20dddf8b6b req-ab8470fb-5573-4916-91a7-2220a0c56afc service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 1098 time: 0.0446906 Nov 11 17:18:22.062043 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:22.072349 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-afea2fca-5218-4649-b38e-7f20dddf8b6b req-51b4086b-1e22-423e-8b69-32e216489747 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402858 Nov 11 17:18:22.167093 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:22.209633 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:18:22.213592 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:18:22.217472 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:18:22.223629 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event updated for resources: {'Port': ['ID=b300149d-6b5d-4954-a7d9-daf56ede73a9,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:22.312154 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:22.453262 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:22.604083 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:22.669182 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:22.745787 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event updated for resources: {'Port': ['ID=b300149d-6b5d-4954-a7d9-daf56ede73a9,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:22.757215 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:22.844104 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:22.845763 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-e7532b1e-49a0-43c1-961c-62c157d2bd43 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.3054774 Nov 11 17:18:22.977748 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24d772de-c9d4-40b7-b914-bcbb1ff396f9 req-1a72ec3b-0091-47c4-aa07-7423fcaf1024 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:22.979287 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-24d772de-c9d4-40b7-b914-bcbb1ff396f9 req-1a72ec3b-0091-47c4-aa07-7423fcaf1024 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0635741 Nov 11 17:18:23.030836 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-24d772de-c9d4-40b7-b914-bcbb1ff396f9 req-d3032f94-df2e-449e-bacd-93f7e7bc65a9 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454626 Nov 11 17:18:23.077826 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-80adffc9-5d26-4f4a-99fb-3c957ba7a5c7 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-securitygroup--445292402&fields=id&tenant_id=3a6e5bdc578b460ab28a883efa598f95 HTTP/1.1" status: 200 len: 267 time: 0.0506766 Nov 11 17:18:23.206371 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-0d8f06f8-9004-41a0-aeb3-591e66be0903 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:23.207611 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-0d8f06f8-9004-41a0-aeb3-591e66be0903 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/networks?id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f HTTP/1.1" status: 200 len: 816 time: 0.1224873 Nov 11 17:18:23.227961 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-0e5608ab-5440-4cae-b614-56881190f19f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/quotas/3a6e5bdc578b460ab28a883efa598f95 HTTP/1.1" status: 200 len: 375 time: 0.0141044 Nov 11 17:18:23.287558 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-306a0eb7-c1b3-4546-bd89-f5425971c5ad tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=3a6e5bdc578b460ab28a883efa598f95&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0530558 Nov 11 17:18:23.395536 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-bc42cb6c-1a92-4f2b-826f-641963a10af6 service neutron] 10.222.0.16 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0886526 Nov 11 17:18:23.490961 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-4c571c9e-87c1-4bcc-8681-989c84e937ea service neutron] 10.222.0.16 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0891871 Nov 11 17:18:23.734964 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-878a32e7-d5e1-47cf-bef3-0bf2ed292e5b req-efd5d513-56e4-4485-b731-8609615854d0 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 210 time: 0.0303793 Nov 11 17:18:24.162410 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f9b8a88-5e38-49c3-8387-d92ebb4c78f5 req-f2652243-2c04-49ae-bef2-524e1a460301 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:24.163963 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8f9b8a88-5e38-49c3-8387-d92ebb4c78f5 req-f2652243-2c04-49ae-bef2-524e1a460301 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0563269 Nov 11 17:18:24.219274 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8f9b8a88-5e38-49c3-8387-d92ebb4c78f5 req-11444599-6df7-4778-a168-5675431d203a tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463495 Nov 11 17:18:24.363566 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15429cf3-8efd-4d10-8ddb-989edc64612d req-2ad8abc0-ce24-4fd0-b982-8dd5b165e76e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:24.366140 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-15429cf3-8efd-4d10-8ddb-989edc64612d req-2ad8abc0-ce24-4fd0-b982-8dd5b165e76e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0632267 Nov 11 17:18:24.377586 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 34192) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:18:24.382150 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-209e539d-76b6-414b-8a63-28956f517fe7 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Request body: {'floatingip': {'port_id': 'ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:18:24.424917 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-209e539d-76b6-414b-8a63-28956f517fe7 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for floatingip, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:24.876290 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c06bce68-d006-4956-9a19-2a84e7d7043a req-2986c446-1d6e-4516-b57d-b42758df66f5 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 210 time: 0.0401435 Nov 11 17:18:24.910449 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-209e539d-76b6-414b-8a63-28956f517fe7 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:25.018567 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-209e539d-76b6-414b-8a63-28956f517fe7 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:25.161202 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.l3_db [None req-209e539d-76b6-414b-8a63-28956f517fe7 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Floating IP 4fcfc590-ae2f-475e-a84e-e1ea081069bb associated. External IP: 172.27.1.227, port: ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8. Nov 11 17:18:25.383830 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-209e539d-76b6-414b-8a63-28956f517fe7 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Router 98cb701e-467a-4425-90db-9dbc5f732760 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:18:25.493911 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-209e539d-76b6-414b-8a63-28956f517fe7 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:18:25.498947 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-209e539d-76b6-414b-8a63-28956f517fe7 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:25.504518 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a2dcb26-6001-40f5-a20e-42577c77bc71 None None] Sync routers for ids ['98cb701e-467a-4425-90db-9dbc5f732760'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:18:25.515224 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a2dcb26-6001-40f5-a20e-42577c77bc71 None None] Routers {'98cb701e-467a-4425-90db-9dbc5f732760'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:18:25.515779 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-2a2dcb26-6001-40f5-a20e-42577c77bc71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:18:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['98cb701e-467a-4425-90db-9dbc5f732760'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:25.529846 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-209e539d-76b6-414b-8a63-28956f517fe7 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "PUT /v2.0/floatingips/4fcfc590-ae2f-475e-a84e-e1ea081069bb HTTP/1.1" status: 200 len: 991 time: 1.1485710 Nov 11 17:18:25.529846 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '59f9c130-2087-4e5f-ad8c-1411737fd8a6', 'tag': 'ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:18:25.530357 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2b370c79-e94f-455d-8fa3-ff1484f29a16" -d '{"events": [{"name": "network-changed", "server_uuid": "59f9c130-2087-4e5f-ad8c-1411737fd8a6", "tag": "ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:18:25.570735 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:18:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e941d0e3-26b2-46b7-88fb-a135fd31d969 x-openstack-request-id: req-e941d0e3-26b2-46b7-88fb-a135fd31d969 {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:18:25.571071 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "59f9c130-2087-4e5f-ad8c-1411737fd8a6", "tag": "ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:18:25.571317 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-e941d0e3-26b2-46b7-88fb-a135fd31d969 {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:18:25.571716 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '59f9c130-2087-4e5f-ad8c-1411737fd8a6', 'tag': 'ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8', 'status': 'completed', 'code': 200} Nov 11 17:18:25.634870 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-2a2dcb26-6001-40f5-a20e-42577c77bc71 None None] Set router 98cb701e-467a-4425-90db-9dbc5f732760 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:18:25.649984 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b370c79-e94f-455d-8fa3-ff1484f29a16 req-bf6b4b7b-8339-460e-a388-1e1c8a764985 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:25.651547 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2b370c79-e94f-455d-8fa3-ff1484f29a16 req-bf6b4b7b-8339-460e-a388-1e1c8a764985 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=7e951c2eae284261a98b317ec84140db&device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 1098 time: 0.0509934 Nov 11 17:18:25.751165 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b370c79-e94f-455d-8fa3-ff1484f29a16 req-627c82b5-8c7d-4d7c-8c26-bc961b3f39d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:25.752565 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2b370c79-e94f-455d-8fa3-ff1484f29a16 req-627c82b5-8c7d-4d7c-8c26-bc961b3f39d9 service neutron] 10.222.0.10 "GET /v2.0/networks?id=10ac93d3-f14d-4df5-a044-d683e35c1ab8 HTTP/1.1" status: 200 len: 912 time: 0.0940118 Nov 11 17:18:25.915933 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-2a2dcb26-6001-40f5-a20e-42577c77bc71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '4fcfc590-ae2f-475e-a84e-e1ea081069bb', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'floating_ip_address': '172.27.1.227', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'port_id': 'ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 530, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'mac_address': 'fa:16:3e:00:f4:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '59f9c130-2087-4e5f-ad8c-1411737fd8a6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:18:06Z', 'updated_at': '2021-11-11T17:18:24Z', 'revision_number': 1, 'project_id': '7e951c2eae284261a98b317ec84140db', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a', 'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'mac_address': 'fa:16:3e:04:45:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:18:01Z', 'updated_at': '2021-11-11T17:18:07Z', 'revision_number': 5, 'project_id': '7e951c2eae284261a98b317ec84140db', 'subnets': [{'id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:25.942322 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a2dcb26-6001-40f5-a20e-42577c77bc71 None None] Checking router: 98cb701e-467a-4425-90db-9dbc5f732760 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:18:25.951680 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a2dcb26-6001-40f5-a20e-42577c77bc71 None None] Routers {'98cb701e-467a-4425-90db-9dbc5f732760'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:18:25.952300 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-2a2dcb26-6001-40f5-a20e-42577c77bc71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:18:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['98cb701e-467a-4425-90db-9dbc5f732760'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:25.982920 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-616acf6a-7cba-49ed-9828-3eed6a5aeb28 req-4c390eeb-a4e4-4d4c-9b7b-c0e877a6330d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 210 time: 0.0276444 Nov 11 17:18:26.066421 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-2a2dcb26-6001-40f5-a20e-42577c77bc71 None None] Set router 98cb701e-467a-4425-90db-9dbc5f732760 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:18:26.312467 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-2a2dcb26-6001-40f5-a20e-42577c77bc71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '4fcfc590-ae2f-475e-a84e-e1ea081069bb', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'floating_ip_address': '172.27.1.227', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'port_id': 'ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 530, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'mac_address': 'fa:16:3e:00:f4:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '59f9c130-2087-4e5f-ad8c-1411737fd8a6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:18:06Z', 'updated_at': '2021-11-11T17:18:24Z', 'revision_number': 1, 'project_id': '7e951c2eae284261a98b317ec84140db', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a', 'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'mac_address': 'fa:16:3e:04:45:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:18:01Z', 'updated_at': '2021-11-11T17:18:07Z', 'revision_number': 5, 'project_id': '7e951c2eae284261a98b317ec84140db', 'subnets': [{'id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:26.339587 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a2dcb26-6001-40f5-a20e-42577c77bc71 None None] The sync data for ids ['98cb701e-467a-4425-90db-9dbc5f732760'] in dv-cinder-694140-2-iscsi is: [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '4fcfc590-ae2f-475e-a84e-e1ea081069bb', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'floating_ip_address': '172.27.1.227', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'port_id': 'ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 530, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'mac_address': 'fa:16:3e:00:f4:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '59f9c130-2087-4e5f-ad8c-1411737fd8a6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:18:06Z', 'updated_at': '2021-11-11T17:18:24Z', 'revision_number': 1, 'project_id': '7e951c2eae284261a98b317ec84140db', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a', 'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'mac_address': 'fa:16:3e:04:45:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:18:01Z', 'updated_at': '2021-11-11T17:18:07Z', 'revision_number': 5, 'project_id': '7e951c2eae284261a98b317ec84140db', 'subnets': [{'id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:18:26.530340 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8f78e7f-248b-48f9-9209-b8517fae6b9f None None] New status for floating IP 4fcfc590-ae2f-475e-a84e-e1ea081069bb: ACTIVE {{(pid=102326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:18:26.787639 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2b370c79-e94f-455d-8fa3-ff1484f29a16 req-d4b81ae5-1ebc-4f31-a089-cbe7c67ede44 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 HTTP/1.1" status: 200 len: 999 time: 0.0636635 Nov 11 17:18:27.090371 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bbec741e-8627-4883-bbae-59a01e09cfd8 req-9b350d50-ff42-4f0f-9140-b51deacdf753 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 210 time: 0.0277922 Nov 11 17:18:28.190450 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5a24cfc1-8396-425a-91c7-4cff3b3d4a9c req-01ab4ae9-6bf4-4074-ae41-bce28c0d2521 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 210 time: 0.0267067 Nov 11 17:18:28.692625 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b370c79-e94f-455d-8fa3-ff1484f29a16 req-83a68db8-c927-4be7-9dbb-0a9c2ce35598 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:28.694158 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2b370c79-e94f-455d-8fa3-ff1484f29a16 req-83a68db8-c927-4be7-9dbb-0a9c2ce35598 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba HTTP/1.1" status: 200 len: 850 time: 0.0600810 Nov 11 17:18:28.761702 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b370c79-e94f-455d-8fa3-ff1484f29a16 req-69638777-d95e-496e-a174-1c6398611f6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:28.763120 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2b370c79-e94f-455d-8fa3-ff1484f29a16 req-69638777-d95e-496e-a174-1c6398611f6e service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=10ac93d3-f14d-4df5-a044-d683e35c1ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0595653 Nov 11 17:18:28.788973 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-0b50b872-7d77-488b-8e83-7dbf5bc93465 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:28.796065 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-0b50b872-7d77-488b-8e83-7dbf5bc93465 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.10 "GET /v2.0/networks?id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f HTTP/1.1" status: 200 len: 816 time: 0.1554670 Nov 11 17:18:28.877605 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2b370c79-e94f-455d-8fa3-ff1484f29a16 req-21d6c104-f481-4a78-b89a-2d1c9999cb1c service neutron] 10.222.0.10 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1060617 Nov 11 17:18:28.887568 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-9c5ddc04-d982-4a0e-ace1-f13f44a47a08 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3a6e5bdc578b460ab28a883efa598f95 HTTP/1.1" status: 200 len: 379 time: 0.0815725 Nov 11 17:18:28.896890 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-17a94a41-5c89-458a-8f1d-bbf59b6baa93 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Request body: {'port': {'device_id': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'admin_state_up': True, 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'security_groups': ['438d3606-b70e-495a-a217-7f77d339ec4f']}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:18:29.006759 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2b370c79-e94f-455d-8fa3-ff1484f29a16 req-39a9b6f5-9af4-47d5-a021-939e851eabf5 service neutron] 10.222.0.10 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1214974 Nov 11 17:18:29.131677 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-17a94a41-5c89-458a-8f1d-bbf59b6baa93 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Made reservation on behalf of 3a6e5bdc578b460ab28a883efa598f95 for: {'port': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:18:29.136310 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-17a94a41-5c89-458a-8f1d-bbf59b6baa93 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:29.311498 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1a134660-2fb8-4269-a692-3b1a3e0541ee req-34ea8a36-1d2a-4757-aa3f-deac95c80a80 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 210 time: 0.0407052 Nov 11 17:18:29.320378 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-17a94a41-5c89-458a-8f1d-bbf59b6baa93 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Allocated IP 172.20.0.13 (4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f/1a4b11d7-2160-49c3-be78-265f0700c580/82611dc2-0b34-439a-ab93-c3b0445d2747) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:18:29.474239 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-17a94a41-5c89-458a-8f1d-bbf59b6baa93 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:29.567240 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-17a94a41-5c89-458a-8f1d-bbf59b6baa93 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:29.624627 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-17a94a41-5c89-458a-8f1d-bbf59b6baa93 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:18:29.633957 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-17a94a41-5c89-458a-8f1d-bbf59b6baa93 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:18:29.636761 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17a94a41-5c89-458a-8f1d-bbf59b6baa93 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event updated for resources: {'Port': ['ID=82611dc2-0b34-439a-ab93-c3b0445d2747,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:29.639951 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-17a94a41-5c89-458a-8f1d-bbf59b6baa93 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:18:29.708015 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-17a94a41-5c89-458a-8f1d-bbf59b6baa93 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:29.708921 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-17a94a41-5c89-458a-8f1d-bbf59b6baa93 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:29.796964 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-17a94a41-5c89-458a-8f1d-bbf59b6baa93 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9038696 Nov 11 17:18:29.815438 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Request body: {'port': {'device_id': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:18:29.881950 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:29.897300 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-0f60d4c7-0fa2-47f9-a7bd-39c137978858 None None] Provisioning complete for port 82611dc2-0b34-439a-ab93-c3b0445d2747 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:18:29.898572 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-0f60d4c7-0fa2-47f9-a7bd-39c137978858 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:29.947130 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-0f60d4c7-0fa2-47f9-a7bd-39c137978858 None None] Port 82611dc2-0b34-439a-ab93-c3b0445d2747 cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:18:30.218240 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 82611dc2-0b34-439a-ab93-c3b0445d2747 {{(pid=102324) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:18:30.226260 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:30.238709 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.provisioning_blocks [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Transition to ACTIVE for port object 82611dc2-0b34-439a-ab93-c3b0445d2747 will not be triggered until provisioned by entity L2. {{(pid=102324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:18:30.291619 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:30.352100 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Pushing event updated for resources: {'Port': ['ID=82611dc2-0b34-439a-ab93-c3b0445d2747,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:30.463558 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Attempting to bind port 82611dc2-0b34-439a-ab93-c3b0445d2747 on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:18:30.463888 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Attempting to bind port 82611dc2-0b34-439a-ab93-c3b0445d2747 by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:18:30.464195 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Attempting to bind port 82611dc2-0b34-439a-ab93-c3b0445d2747 on network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:18:30.471637 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Port 82611dc2-0b34-439a-ab93-c3b0445d2747 on network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:18:30.471974 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Attempting to bind port 82611dc2-0b34-439a-ab93-c3b0445d2747 on network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:18:30.488547 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7002c94-b9ad-4ba6-a44e-7028fabecf41 req-2f1615f4-6b71-48e5-8ed9-4ec955813edb tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:30.490071 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b7002c94-b9ad-4ba6-a44e-7028fabecf41 req-2f1615f4-6b71-48e5-8ed9-4ec955813edb tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0776870 Nov 11 17:18:30.491069 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 18, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:18:30.491945 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Checking segment: {'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:18:30.492316 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Bound using segment: {'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:18:30.492754 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Bound port: 82611dc2-0b34-439a-ab93-c3b0445d2747, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '47be9a7f-0eae-411b-a3de-e2c448d6c842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f'}}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:18:30.493102 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:30.589925 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b7002c94-b9ad-4ba6-a44e-7028fabecf41 req-a2d297d5-5a9f-4ab8-ac27-ce0ae537a898 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0875382 Nov 11 17:18:30.596456 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] For port 82611dc2-0b34-439a-ab93-c3b0445d2747, host hv-cinder-69414, cleared binding levels {{(pid=102324) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:18:30.601260 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] For port 82611dc2-0b34-439a-ab93-c3b0445d2747, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=82611dc2-0b34-439a-ab93-c3b0445d2747,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102324) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:18:30.664173 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:30.698968 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:30.699502 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:30.700873 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] 10.222.0.10 "PUT /v2.0/ports/82611dc2-0b34-439a-ab93-c3b0445d2747 HTTP/1.1" status: 200 len: 1094 time: 0.8941560 Nov 11 17:18:30.701312 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'tag': '82611dc2-0b34-439a-ab93-c3b0445d2747'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:18:30.703562 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-547bda32-48ef-40ad-b5ea-52f7defaa886" -d '{"events": [{"name": "network-changed", "server_uuid": "db6c7ef4-59ed-41b0-9bd7-c576ebecf33e", "tag": "82611dc2-0b34-439a-ab93-c3b0445d2747"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:18:30.732838 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00378867-613e-42c8-93ee-4f3d60598bec service neutron] Pushing event updated for resources: {'Port': ['ID=82611dc2-0b34-439a-ab93-c3b0445d2747,revision_number=3']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:30.750052 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:18:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-29b04794-8300-4450-bfb0-694767fc9252 x-openstack-request-id: req-29b04794-8300-4450-bfb0-694767fc9252 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:18:30.750338 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "db6c7ef4-59ed-41b0-9bd7-c576ebecf33e", "tag": "82611dc2-0b34-439a-ab93-c3b0445d2747", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:18:30.750690 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-29b04794-8300-4450-bfb0-694767fc9252 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:18:30.751101 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'tag': '82611dc2-0b34-439a-ab93-c3b0445d2747', 'status': 'completed', 'code': 200} Nov 11 17:18:31.033762 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c685d5c8-eb80-4972-af0d-5ed749401e28 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:31.745345 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae8ffe5f-bc39-43fc-a502-664c45435211 req-a5ada6b9-c0d5-4284-ac25-744d77b45326 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:31.746953 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ae8ffe5f-bc39-43fc-a502-664c45435211 req-a5ada6b9-c0d5-4284-ac25-744d77b45326 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0645070 Nov 11 17:18:31.805477 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ae8ffe5f-bc39-43fc-a502-664c45435211 req-c3ada6e1-5268-41ac-9d4b-e1ddea229897 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443017 Nov 11 17:18:32.932764 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9be2c565-8e33-45f7-b629-9efbe8e31c1a req-a5c4c4cc-5e1f-4dba-a6bc-3363508be128 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:32.934148 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9be2c565-8e33-45f7-b629-9efbe8e31c1a req-a5c4c4cc-5e1f-4dba-a6bc-3363508be128 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0527203 Nov 11 17:18:32.983748 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9be2c565-8e33-45f7-b629-9efbe8e31c1a req-036ca08d-6178-4ebc-90fb-f1f9e69b310b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434957 Nov 11 17:18:33.222045 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-547bda32-48ef-40ad-b5ea-52f7defaa886 req-6a9355c9-4573-49b8-870a-07dbc1ba5d80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:33.223632 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-547bda32-48ef-40ad-b5ea-52f7defaa886 req-6a9355c9-4573-49b8-870a-07dbc1ba5d80 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=3a6e5bdc578b460ab28a883efa598f95&device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 1097 time: 0.0433705 Nov 11 17:18:33.398636 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-547bda32-48ef-40ad-b5ea-52f7defaa886 req-76e401c6-82a2-41dc-bc73-9001ab9d1d20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:33.400270 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-547bda32-48ef-40ad-b5ea-52f7defaa886 req-76e401c6-82a2-41dc-bc73-9001ab9d1d20 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=3a6e5bdc578b460ab28a883efa598f95&shared=False HTTP/1.1" status: 200 len: 917 time: 0.1677611 Nov 11 17:18:33.491894 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b798d56e-aa11-4422-aa2f-b6848e61b230 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:33.497579 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-547bda32-48ef-40ad-b5ea-52f7defaa886 req-cf00e46e-9fd5-4f6e-b0b6-4c04a147b96e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:33.499086 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-547bda32-48ef-40ad-b5ea-52f7defaa886 req-cf00e46e-9fd5-4f6e-b0b6-4c04a147b96e service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0916643 Nov 11 17:18:33.590039 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-1298958e-91db-4ba6-ae9e-2bd67eb6f53c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:33.591597 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-1298958e-91db-4ba6-ae9e-2bd67eb6f53c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=3a6e5bdc578b460ab28a883efa598f95&device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 1097 time: 0.0434690 Nov 11 17:18:33.639919 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-bc94f288-e7fa-4741-bd15-c75bdbcb24ee service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=82611dc2-0b34-439a-ab93-c3b0445d2747 HTTP/1.1" status: 200 len: 217 time: 0.0361288 Nov 11 17:18:33.689526 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-0f77e2dd-ff95-4796-b8dc-9ebace93bec9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:33.690986 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-0f77e2dd-ff95-4796-b8dc-9ebace93bec9 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=1a4b11d7-2160-49c3-be78-265f0700c580 HTTP/1.1" status: 200 len: 855 time: 0.0433714 Nov 11 17:18:33.744150 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-3ac20b9f-e437-4bf2-aa0b-0d3267295549 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:33.745548 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-3ac20b9f-e437-4bf2-aa0b-0d3267295549 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0478058 Nov 11 17:18:33.842571 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-6d37640e-2196-4c9e-b686-63216980f181 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0899715 Nov 11 17:18:33.932329 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-315dc24c-06f9-4b52-bb20-f27baf28b416 req-41c4ec16-24c9-4f83-82aa-9e35b34f6448 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823188 Nov 11 17:18:34.117864 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6965c267-4f8c-4ebd-9e59-9b91e61103d4 req-349b4267-7b8d-4be3-b53a-686bb4e3416b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:34.119604 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6965c267-4f8c-4ebd-9e59-9b91e61103d4 req-349b4267-7b8d-4be3-b53a-686bb4e3416b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0597267 Nov 11 17:18:34.174576 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6965c267-4f8c-4ebd-9e59-9b91e61103d4 req-8b573474-9e36-4f38-bc39-a31e8944acc1 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0486758 Nov 11 17:18:34.588902 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:35.310297 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28d376f7-dc01-4622-98bf-128f84732038 req-d5156a94-1e6d-4c12-a82d-e04f0af3441f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:35.311854 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-28d376f7-dc01-4622-98bf-128f84732038 req-d5156a94-1e6d-4c12-a82d-e04f0af3441f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0536728 Nov 11 17:18:35.365112 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-28d376f7-dc01-4622-98bf-128f84732038 req-0b3a77e6-4ecb-492a-bcf9-0e1ce7e6af03 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461802 Nov 11 17:18:36.161661 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 82611dc2-0b34-439a-ab93-c3b0445d2747 details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:18:36.273145 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 82611dc2-0b34-439a-ab93-c3b0445d2747, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=82611dc2-0b34-439a-ab93-c3b0445d2747,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:18:36.284829 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '82611dc2-0b34-439a-ab93-c3b0445d2747', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'port_id': '82611dc2-0b34-439a-ab93-c3b0445d2747', 'mac_address': 'fa:16:3e:34:67:78', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 538, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:18:36.312015 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:36.323380 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:36.337462 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 82611dc2-0b34-439a-ab93-c3b0445d2747 {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:18:36.358397 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 82611dc2-0b34-439a-ab93-c3b0445d2747, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=82611dc2-0b34-439a-ab93-c3b0445d2747,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:18:36.445938 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:36.504950 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=82611dc2-0b34-439a-ab93-c3b0445d2747,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:36.528726 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b397be73-5f76-41a5-bd9a-2c099c838e1d req-02a7e4ff-a229-46b3-b9f5-a9aaaec86d74 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:36.530295 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b397be73-5f76-41a5-bd9a-2c099c838e1d req-02a7e4ff-a229-46b3-b9f5-a9aaaec86d74 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 945 time: 0.0626774 Nov 11 17:18:36.582138 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b397be73-5f76-41a5-bd9a-2c099c838e1d req-cffacd82-4d90-431d-948a-72818fdc7913 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457392 Nov 11 17:18:36.703997 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['82611dc2-0b34-439a-ab93-c3b0445d2747'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:18:36.994485 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:37.716922 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecc7d104-555a-46ef-873d-4aaa4d52d521 req-dd35f9d4-b203-4a3f-a622-af6fc8d004b7 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:37.718404 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ecc7d104-555a-46ef-873d-4aaa4d52d521 req-dd35f9d4-b203-4a3f-a622-af6fc8d004b7 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 945 time: 0.0539439 Nov 11 17:18:37.773334 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ecc7d104-555a-46ef-873d-4aaa4d52d521 req-1b97e6c2-0e25-4405-b862-f6ddd8b05dcf tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0486829 Nov 11 17:18:38.169078 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 82611dc2-0b34-439a-ab93-c3b0445d2747 up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:18:38.267894 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port 82611dc2-0b34-439a-ab93-c3b0445d2747 completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:18:38.272116 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 82611dc2-0b34-439a-ab93-c3b0445d2747 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:18:38.272992 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:38.479422 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:38.504271 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '82611dc2-0b34-439a-ab93-c3b0445d2747'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:18:38.506532 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-129a2aa2-f8aa-4d5e-9e60-dde68df321df" -d '{"events": [{"server_uuid": "db6c7ef4-59ed-41b0-9bd7-c576ebecf33e", "name": "network-vif-plugged", "status": "completed", "tag": "82611dc2-0b34-439a-ab93-c3b0445d2747"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:18:38.525492 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 82611dc2-0b34-439a-ab93-c3b0445d2747, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=82611dc2-0b34-439a-ab93-c3b0445d2747,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:18:38.549349 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:18:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dfad2988-e2ef-462b-a616-c4cfde5528fe x-openstack-request-id: req-dfad2988-e2ef-462b-a616-c4cfde5528fe {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:18:38.549661 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "db6c7ef4-59ed-41b0-9bd7-c576ebecf33e", "name": "network-vif-plugged", "status": "completed", "tag": "82611dc2-0b34-439a-ab93-c3b0445d2747", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:18:38.549913 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-dfad2988-e2ef-462b-a616-c4cfde5528fe {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:18:38.550373 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '82611dc2-0b34-439a-ab93-c3b0445d2747', 'code': 200} Nov 11 17:18:38.583060 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:38.638830 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=82611dc2-0b34-439a-ab93-c3b0445d2747,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:38.935452 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b9f9396-b124-4417-86a0-cd41853e4ec4 req-be16939f-c237-4783-b6d0-00b64abda36d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:38.936933 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9b9f9396-b124-4417-86a0-cd41853e4ec4 req-be16939f-c237-4783-b6d0-00b64abda36d service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 1099 time: 0.0930474 Nov 11 17:18:38.949923 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df6ee47-125c-4d17-ac5e-79a175c25e2c req-e12d05f4-b8cd-40d5-8dec-57052965b352 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:38.951390 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5df6ee47-125c-4d17-ac5e-79a175c25e2c req-e12d05f4-b8cd-40d5-8dec-57052965b352 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0737262 Nov 11 17:18:39.031567 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9b9f9396-b124-4417-86a0-cd41853e4ec4 req-aa00c40a-c998-44bf-9d5a-daad3ccb3eb8 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0792141 Nov 11 17:18:39.039879 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5df6ee47-125c-4d17-ac5e-79a175c25e2c req-b5e5ff74-06e5-4aa2-bb80-53df8f8bef67 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0811775 Nov 11 17:18:39.556999 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f9e682-bbd5-4308-b3c4-a64f6af90154 req-6d70bb69-3029-4e5e-b4c2-56d449f3566f tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:39.558489 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a7f9e682-bbd5-4308-b3c4-a64f6af90154 req-6d70bb69-3029-4e5e-b4c2-56d449f3566f tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 945 time: 0.0505154 Nov 11 17:18:39.607445 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a7f9e682-bbd5-4308-b3c4-a64f6af90154 req-290ac65a-4267-4bbf-a24d-fb872cb7d855 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428467 Nov 11 17:18:40.186789 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb054e95-cf32-4b1a-b595-5d12290c53d9 req-7fcba8ba-0a0d-4f80-a2f4-c67dbf442c38 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:40.188256 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-fb054e95-cf32-4b1a-b595-5d12290c53d9 req-7fcba8ba-0a0d-4f80-a2f4-c67dbf442c38 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0508714 Nov 11 17:18:40.240733 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-fb054e95-cf32-4b1a-b595-5d12290c53d9 req-78296098-d42e-48bc-8c10-18e9c9f26348 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463269 Nov 11 17:18:40.724116 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d6627a7-a66e-4082-81be-0534a92a904b req-05d8bf27-c50b-4286-b695-4da087e0852e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:40.726051 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6d6627a7-a66e-4082-81be-0534a92a904b req-05d8bf27-c50b-4286-b695-4da087e0852e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 945 time: 0.0484371 Nov 11 17:18:40.777585 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6d6627a7-a66e-4082-81be-0534a92a904b req-c34430d5-34a7-482e-9198-0cd9c40a3403 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455072 Nov 11 17:18:41.365149 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-009ef6dd-356f-4963-80e7-35f188c52765 req-95a56b9b-f9a6-4f19-95aa-25b1739ac7ae tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:41.367372 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-009ef6dd-356f-4963-80e7-35f188c52765 req-95a56b9b-f9a6-4f19-95aa-25b1739ac7ae tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0497105 Nov 11 17:18:41.419136 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea239f3-5c46-46af-8ca6-252563169e04 req-3f677587-43df-4dcc-8715-299ca1e1945e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:41.420592 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bea239f3-5c46-46af-8ca6-252563169e04 req-3f677587-43df-4dcc-8715-299ca1e1945e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.10 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 945 time: 0.0486877 Nov 11 17:18:41.421817 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-009ef6dd-356f-4963-80e7-35f188c52765 req-d008da1f-23c5-455d-9e97-a794b1b5603b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0482557 Nov 11 17:18:41.545367 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-bea239f3-5c46-46af-8ca6-252563169e04 req-7a25ef5e-55a8-41b3-8db3-37f34ec81e3c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Deleting port a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:18:41.545686 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-bea239f3-5c46-46af-8ca6-252563169e04 req-7a25ef5e-55a8-41b3-8db3-37f34ec81e3c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:41.579594 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cbc11d4-2756-48d2-a535-6dce3c47296c req-5f92db42-7557-4ead-8380-babed290a94b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:41.580227 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1cbc11d4-2756-48d2-a535-6dce3c47296c req-5f92db42-7557-4ead-8380-babed290a94b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0848143 Nov 11 17:18:41.590734 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 34322) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:18:41.599709 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-acd18bd8-1729-46e1-9dd0-239fec876844 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Request body: {'floatingip': {'port_id': '82611dc2-0b34-439a-ab93-c3b0445d2747'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:18:41.638007 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-acd18bd8-1729-46e1-9dd0-239fec876844 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for floatingip, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:41.644560 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-bea239f3-5c46-46af-8ca6-252563169e04 req-7a25ef5e-55a8-41b3-8db3-37f34ec81e3c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] For port a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16,segment=NetworkSegment(92668025-4f51-4378-b7fa-fd59b584fd19),segment_id=92668025-4f51-4378-b7fa-fd59b584fd19)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:18:41.644931 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-bea239f3-5c46-46af-8ca6-252563169e04 req-7a25ef5e-55a8-41b3-8db3-37f34ec81e3c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:41.657885 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-bea239f3-5c46-46af-8ca6-252563169e04 req-7a25ef5e-55a8-41b3-8db3-37f34ec81e3c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Calling delete_port for a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 owned by compute:nova {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:18:41.979438 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e050383-2975-427d-80ec-331474ead5c0 req-520dc837-9d6b-4763-ad8c-ae191a4b46f4 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:41.999760 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6e050383-2975-427d-80ec-331474ead5c0 req-520dc837-9d6b-4763-ad8c-ae191a4b46f4 tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 945 time: 0.1277006 Nov 11 17:18:42.051531 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-bea239f3-5c46-46af-8ca6-252563169e04 req-7a25ef5e-55a8-41b3-8db3-37f34ec81e3c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:42.066121 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:18:42.091453 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6e050383-2975-427d-80ec-331474ead5c0 req-5c77a488-0d89-443d-8af4-6dea0b33f20e tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/security-groups?id=991c1715-5109-4fc3-8225-d53b129684ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0803339 Nov 11 17:18:42.096367 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a25ef5e-55a8-41b3-8db3-37f34ec81e3c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Pushing event deleted for resources: {'Port': ['ID=a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:18:42.147193 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-bea239f3-5c46-46af-8ca6-252563169e04 req-7a25ef5e-55a8-41b3-8db3-37f34ec81e3c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] No DVR routers for this DVR port a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 on host hv-cinder-69414 {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:18:42.149999 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-bea239f3-5c46-46af-8ca6-252563169e04 req-7a25ef5e-55a8-41b3-8db3-37f34ec81e3c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:42.164016 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bea239f3-5c46-46af-8ca6-252563169e04 req-7a25ef5e-55a8-41b3-8db3-37f34ec81e3c tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.10 "DELETE /v2.0/ports/a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 HTTP/1.1" status: 204 len: 173 time: 0.7267451 Nov 11 17:18:42.164016 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '50403429-91ff-4288-bb15-d8c8a96d1829', 'name': 'network-vif-deleted', 'tag': 'a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:18:42.164016 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-00ec9512-bde7-4d03-96e8-f9c8cb2a10b9" -d '{"events": [{"server_uuid": "50403429-91ff-4288-bb15-d8c8a96d1829", "name": "network-vif-deleted", "tag": "a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:18:42.168482 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-acd18bd8-1729-46e1-9dd0-239fec876844 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:42.198666 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:18:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6d0a0980-31db-443d-944c-9af2b8807b7b x-openstack-request-id: req-6d0a0980-31db-443d-944c-9af2b8807b7b {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:18:42.198954 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "50403429-91ff-4288-bb15-d8c8a96d1829", "name": "network-vif-deleted", "tag": "a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:18:42.199193 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-6d0a0980-31db-443d-944c-9af2b8807b7b {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:18:42.199654 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '50403429-91ff-4288-bb15-d8c8a96d1829', 'name': 'network-vif-deleted', 'tag': 'a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16', 'status': 'completed', 'code': 200} Nov 11 17:18:42.228349 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-acd18bd8-1729-46e1-9dd0-239fec876844 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:42.329733 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.l3_db [None req-acd18bd8-1729-46e1-9dd0-239fec876844 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Floating IP 047e3c82-79fa-478c-86dc-decb34ef9559 associated. External IP: 172.27.1.64, port: 82611dc2-0b34-439a-ab93-c3b0445d2747. Nov 11 17:18:42.553451 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-acd18bd8-1729-46e1-9dd0-239fec876844 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Router 1a70d97d-215a-45d3-ba2b-b538e79a3278 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:18:42.663627 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-acd18bd8-1729-46e1-9dd0-239fec876844 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:18:42.668798 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-acd18bd8-1729-46e1-9dd0-239fec876844 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:42.674190 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb9bdc42-99a5-4838-bc8b-617967bdba38 None None] Sync routers for ids ['1a70d97d-215a-45d3-ba2b-b538e79a3278'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:18:42.691326 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb9bdc42-99a5-4838-bc8b-617967bdba38 None None] Routers {'1a70d97d-215a-45d3-ba2b-b538e79a3278'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:18:42.694631 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-bb9bdc42-99a5-4838-bc8b-617967bdba38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:18:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1a70d97d-215a-45d3-ba2b-b538e79a3278'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:42.695927 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-acd18bd8-1729-46e1-9dd0-239fec876844 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "PUT /v2.0/floatingips/047e3c82-79fa-478c-86dc-decb34ef9559 HTTP/1.1" status: 200 len: 991 time: 1.1040413 Nov 11 17:18:42.696520 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'tag': '82611dc2-0b34-439a-ab93-c3b0445d2747'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:18:42.698879 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8f10c5f7-ea06-4900-8fc4-c045940fb97b" -d '{"events": [{"name": "network-changed", "server_uuid": "db6c7ef4-59ed-41b0-9bd7-c576ebecf33e", "tag": "82611dc2-0b34-439a-ab93-c3b0445d2747"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:18:42.755167 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:18:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2282e8b9-023a-47c3-a032-28060ddf82a9 x-openstack-request-id: req-2282e8b9-023a-47c3-a032-28060ddf82a9 {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:18:42.755665 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "db6c7ef4-59ed-41b0-9bd7-c576ebecf33e", "tag": "82611dc2-0b34-439a-ab93-c3b0445d2747", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:18:42.756086 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-2282e8b9-023a-47c3-a032-28060ddf82a9 {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:18:42.757212 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'tag': '82611dc2-0b34-439a-ab93-c3b0445d2747', 'status': 'completed', 'code': 200} Nov 11 17:18:42.814087 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-bb9bdc42-99a5-4838-bc8b-617967bdba38 None None] Set router 1a70d97d-215a-45d3-ba2b-b538e79a3278 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:18:42.830687 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f10c5f7-ea06-4900-8fc4-c045940fb97b req-95bdaa94-4802-484d-aabf-f6a553753048 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:42.832191 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8f10c5f7-ea06-4900-8fc4-c045940fb97b req-95bdaa94-4802-484d-aabf-f6a553753048 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=3a6e5bdc578b460ab28a883efa598f95&device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 1099 time: 0.0511420 Nov 11 17:18:42.938994 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f10c5f7-ea06-4900-8fc4-c045940fb97b req-e295fc09-372b-4d18-9f97-eeff9d1f30c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:42.940462 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8f10c5f7-ea06-4900-8fc4-c045940fb97b req-e295fc09-372b-4d18-9f97-eeff9d1f30c0 service neutron] 10.222.0.10 "GET /v2.0/networks?id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f HTTP/1.1" status: 200 len: 917 time: 0.0970638 Nov 11 17:18:43.015768 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8f10c5f7-ea06-4900-8fc4-c045940fb97b req-7560d99b-5ee2-495d-95bd-191706c1ca30 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=82611dc2-0b34-439a-ab93-c3b0445d2747 HTTP/1.1" status: 200 len: 999 time: 0.0670004 Nov 11 17:18:43.092669 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f10c5f7-ea06-4900-8fc4-c045940fb97b req-fb4f723a-2e4f-4bf2-aa57-94fe854bf37f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:43.096443 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8f10c5f7-ea06-4900-8fc4-c045940fb97b req-fb4f723a-2e4f-4bf2-aa57-94fe854bf37f service neutron] 10.222.0.10 "GET /v2.0/subnets?id=1a4b11d7-2160-49c3-be78-265f0700c580 HTTP/1.1" status: 200 len: 855 time: 0.0714595 Nov 11 17:18:43.101752 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-bb9bdc42-99a5-4838-bc8b-617967bdba38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '047e3c82-79fa-478c-86dc-decb34ef9559', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'floating_ip_address': '172.27.1.64', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'port_id': '82611dc2-0b34-439a-ab93-c3b0445d2747', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 538, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'mac_address': 'fa:16:3e:34:67:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:18:22Z', 'updated_at': '2021-11-11T17:18:42Z', 'revision_number': 1, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aa2fc75b-4ee8-4417-b781-eb1c551f1c43', 'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'mac_address': 'fa:16:3e:61:80:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:15Z', 'updated_at': '2021-11-11T17:14:22Z', 'revision_number': 5, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'subnets': [{'id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:43.139064 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb9bdc42-99a5-4838-bc8b-617967bdba38 None None] Checking router: 1a70d97d-215a-45d3-ba2b-b538e79a3278 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:18:43.147158 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb9bdc42-99a5-4838-bc8b-617967bdba38 None None] Routers {'1a70d97d-215a-45d3-ba2b-b538e79a3278'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:18:43.147711 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-bb9bdc42-99a5-4838-bc8b-617967bdba38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:18:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1a70d97d-215a-45d3-ba2b-b538e79a3278'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:43.162252 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f10c5f7-ea06-4900-8fc4-c045940fb97b req-ee376b8e-80f0-4213-8a91-191362b1e371 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:18:43.169359 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8f10c5f7-ea06-4900-8fc4-c045940fb97b req-ee376b8e-80f0-4213-8a91-191362b1e371 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0601602 Nov 11 17:18:43.243912 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-75c7a3fb-6ad9-4adf-a637-14fc53538d26 req-8d9c0290-f6e3-417d-ac8d-548eb90e00ea tempest-VolumesSnapshotTestJSON-1107465698 tempest-VolumesSnapshotTestJSON-1107465698-project] 10.222.0.16 "GET /v2.0/ports?device_id=50403429-91ff-4288-bb15-d8c8a96d1829 HTTP/1.1" status: 200 len: 210 time: 0.0364583 Nov 11 17:18:43.296793 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-bb9bdc42-99a5-4838-bc8b-617967bdba38 None None] Set router 1a70d97d-215a-45d3-ba2b-b538e79a3278 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:18:43.527694 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8f10c5f7-ea06-4900-8fc4-c045940fb97b req-43ed0f63-61ae-48be-bfc9-72a9fe86e9ce service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3538234 Nov 11 17:18:43.545916 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-bb9bdc42-99a5-4838-bc8b-617967bdba38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '047e3c82-79fa-478c-86dc-decb34ef9559', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'floating_ip_address': '172.27.1.64', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'port_id': '82611dc2-0b34-439a-ab93-c3b0445d2747', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 538, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'mac_address': 'fa:16:3e:34:67:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:18:22Z', 'updated_at': '2021-11-11T17:18:42Z', 'revision_number': 1, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aa2fc75b-4ee8-4417-b781-eb1c551f1c43', 'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'mac_address': 'fa:16:3e:61:80:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:15Z', 'updated_at': '2021-11-11T17:14:22Z', 'revision_number': 5, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'subnets': [{'id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:18:43.579287 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb9bdc42-99a5-4838-bc8b-617967bdba38 None None] The sync data for ids ['1a70d97d-215a-45d3-ba2b-b538e79a3278'] in dv-cinder-694140-2-iscsi is: [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '047e3c82-79fa-478c-86dc-decb34ef9559', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'floating_ip_address': '172.27.1.64', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'port_id': '82611dc2-0b34-439a-ab93-c3b0445d2747', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 538, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'mac_address': 'fa:16:3e:34:67:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:18:22Z', 'updated_at': '2021-11-11T17:18:42Z', 'revision_number': 1, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aa2fc75b-4ee8-4417-b781-eb1c551f1c43', 'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'mac_address': 'fa:16:3e:61:80:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:15Z', 'updated_at': '2021-11-11T17:14:22Z', 'revision_number': 5, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'subnets': [{'id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:18:43.624543 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8f10c5f7-ea06-4900-8fc4-c045940fb97b req-1273449a-19b4-44af-9ef1-3ab77b811224 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889945 Nov 11 17:18:43.783057 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-132aab14-d433-4021-a430-9e02317c84e5 None None] New status for floating IP 047e3c82-79fa-478c-86dc-decb34ef9559: ACTIVE {{(pid=102326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:18:44.209049 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:18:44.243955 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:18:44.244548 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device a9ea6cf5-a2d8-4454-b1c2-ed6059b88b16 not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:18:46.851062 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:18:58.140018 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:19:00.919181 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b0155654-a9a0-4b54-a327-8cb2ec8beb96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:03.484897 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-92de4b43-75f1-429d-ad40-2c757d6b6252 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:04.575561 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:06.301515 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:06.998435 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:09.926155 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 34548) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:19:09.974247 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_v2 [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Deleting subnet e7b74f8a-11ae-481b-9bec-e05d84a2edc1 {{(pid=102323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:19:09.977924 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:10.014267 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5777079'] for subnet, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:10.056375 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:10.153090 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5720643', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5388326'] for subnet, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:10.178942 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e7b74f8a-11ae-481b-9bec-e05d84a2edc1,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:19:10.183892 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Publish callbacks [] for subnet, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:10.187310 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] 10.222.0.16 "DELETE /v2.0/subnets/e7b74f8a-11ae-481b-9bec-e05d84a2edc1 HTTP/1.1" status: 204 len: 168 time: 0.2600896 Nov 11 17:19:10.189958 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 34550) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:19:10.192256 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:10.192598 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:10.192947 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:10.193264 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:10.193585 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:10.193907 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:10.194227 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:10.194559 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:10.194904 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:10.195223 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:10.195537 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:10.195849 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba5ecf52-60c7-44fb-9d20-c9da5ea1564a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:10.260316 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d388b1d9-b4f3-47fc-852d-844c8ed917b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:10.336259 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d388b1d9-b4f3-47fc-852d-844c8ed917b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:10.356487 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-d388b1d9-b4f3-47fc-852d-844c8ed917b2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3f528faa-b7d7-4ae6-81a7-c001fae97f70']}} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:19:10.365882 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-d388b1d9-b4f3-47fc-852d-844c8ed917b2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '92668025-4f51-4378-b7fa-fd59b584fd19') {'for_net_delete': True} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:19:10.366170 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-d388b1d9-b4f3-47fc-852d-844c8ed917b2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '92668025-4f51-4378-b7fa-fd59b584fd19') {} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:19:10.379469 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d388b1d9-b4f3-47fc-852d-844c8ed917b2 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5895812'] for segment, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:10.392645 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d388b1d9-b4f3-47fc-852d-844c8ed917b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:10.399296 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d388b1d9-b4f3-47fc-852d-844c8ed917b2 admin admin] Releasing vlan 508 on physical network physnet1 to pool {{(pid=102324) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:19:10.399833 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d388b1d9-b4f3-47fc-852d-844c8ed917b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5436270'] for segment, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: Traceback (most recent call last): Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: timer() Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: cb(*args, **kw) Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: return func(*args, **kwargs) Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: self._notify() Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: self.callback(batched_events) Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: event.method(event) Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: return f(self, *a, **k) Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: return self._get(url).json() Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: return self.request(url, 'GET', **kwargs) Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:19:10.401409 dv-cinder-694140-2-iscsi neutron-server[102324]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:19:10.490141 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d388b1d9-b4f3-47fc-852d-844c8ed917b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:10.495441 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-d388b1d9-b4f3-47fc-852d-844c8ed917b2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:10.498802 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-d388b1d9-b4f3-47fc-852d-844c8ed917b2 admin admin] 10.222.0.16 "DELETE /v2.0/networks/3f528faa-b7d7-4ae6-81a7-c001fae97f70 HTTP/1.1" status: 204 len: 168 time: 0.3075986 Nov 11 17:19:10.510289 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d388b1d9-b4f3-47fc-852d-844c8ed917b2 admin admin] Pushing event deleted for resources: {'Network': ['ID=3f528faa-b7d7-4ae6-81a7-c001fae97f70,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:19:10.798163 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 34558) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:19:10.837504 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-8c9e0612-7e3f-4231-a89c-e23cfad3dbf2 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=1b90b3d6739f4eef8dc3f2a78bb8a043&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0381353 Nov 11 17:19:10.840329 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 34560) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:19:10.893527 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d34ff0b0-bc78-45ce-8b22-ad592b3f3f7c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:10.914306 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d34ff0b0-bc78-45ce-8b22-ad592b3f3f7c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:11.015722 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d34ff0b0-bc78-45ce-8b22-ad592b3f3f7c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:11.018309 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d34ff0b0-bc78-45ce-8b22-ad592b3f3f7c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:11.019540 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-d34ff0b0-bc78-45ce-8b22-ad592b3f3f7c admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/991c1715-5109-4fc3-8225-d53b129684ea HTTP/1.1" status: 204 len: 168 time: 0.1781414 Nov 11 17:19:11.027359 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d34ff0b0-bc78-45ce-8b22-ad592b3f3f7c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=991c1715-5109-4fc3-8225-d53b129684ea,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:19:14.929760 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-648b4351-4b9e-469a-9105-9645b33b3127 req-0728b23a-df48-4f65-8949-5e9e86097dcc service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0458386 Nov 11 17:19:14.995868 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-648b4351-4b9e-469a-9105-9645b33b3127 req-5bdbee17-9c26-4cc4-92ef-24de1f183fd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:14.997623 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-648b4351-4b9e-469a-9105-9645b33b3127 req-5bdbee17-9c26-4cc4-92ef-24de1f183fd4 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 1098 time: 0.0415463 Nov 11 17:19:15.100224 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-648b4351-4b9e-469a-9105-9645b33b3127 req-96c97a0d-7d3b-49b5-a2fa-fbf2b8583caf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:15.101678 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-648b4351-4b9e-469a-9105-9645b33b3127 req-96c97a0d-7d3b-49b5-a2fa-fbf2b8583caf service neutron] 10.222.0.10 "GET /v2.0/networks?id=45e6626a-2007-490b-a445-d7c3baea689e HTTP/1.1" status: 200 len: 912 time: 0.0846627 Nov 11 17:19:15.173825 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-648b4351-4b9e-469a-9105-9645b33b3127 req-80bb9f48-d640-4deb-aa6a-e63917dac980 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=187c87f3-1a3e-48da-b88a-46d1ee4144ea HTTP/1.1" status: 200 len: 1001 time: 0.0614328 Nov 11 17:19:15.223441 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-648b4351-4b9e-469a-9105-9645b33b3127 req-1bd8e860-080a-4cc2-b004-eaa2c0076829 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:15.225473 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-648b4351-4b9e-469a-9105-9645b33b3127 req-1bd8e860-080a-4cc2-b004-eaa2c0076829 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=bf78c82f-f2f3-4ef7-8052-be816dbd2df8 HTTP/1.1" status: 200 len: 850 time: 0.0432439 Nov 11 17:19:15.272557 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-648b4351-4b9e-469a-9105-9645b33b3127 req-1f139307-51cd-497e-9997-885a67332f69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:15.274028 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-648b4351-4b9e-469a-9105-9645b33b3127 req-1f139307-51cd-497e-9997-885a67332f69 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=45e6626a-2007-490b-a445-d7c3baea689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0402195 Nov 11 17:19:15.371341 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-648b4351-4b9e-469a-9105-9645b33b3127 req-87f5fc0f-9d4b-4871-90c9-81e68f0bfc0e service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0889316 Nov 11 17:19:15.467797 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-648b4351-4b9e-469a-9105-9645b33b3127 req-8ea1c111-f6a2-4f14-8aa7-a4f02ba7e441 service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850439 Nov 11 17:19:16.872240 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:24.169278 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dc1233f-2639-4a6a-97f1-110d9e44e7c5 req-c0bbacb9-85cc-4b81-b083-2b65cf5c788c tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:24.170874 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5dc1233f-2639-4a6a-97f1-110d9e44e7c5 req-c0bbacb9-85cc-4b81-b083-2b65cf5c788c tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.1553392 Nov 11 17:19:24.220993 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5dc1233f-2639-4a6a-97f1-110d9e44e7c5 req-261aa1d0-c405-48d9-ae43-93cb6023e411 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441287 Nov 11 17:19:25.340438 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cb76e39-4392-4b0f-96fa-7ae247da48c0 req-eaa40a70-7576-4bdf-a477-fe0b97c723fe tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:25.341898 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9cb76e39-4392-4b0f-96fa-7ae247da48c0 req-eaa40a70-7576-4bdf-a477-fe0b97c723fe tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0519047 Nov 11 17:19:25.388433 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9cb76e39-4392-4b0f-96fa-7ae247da48c0 req-9d4b37c1-8b80-4f6e-8bdb-6a782ba21aa0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402584 Nov 11 17:19:26.509605 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c25a960f-f90f-453e-aeaf-455d4725027e req-2926ad5d-a9c4-40f3-81d8-7af16dfefa20 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:26.511256 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c25a960f-f90f-453e-aeaf-455d4725027e req-2926ad5d-a9c4-40f3-81d8-7af16dfefa20 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0545816 Nov 11 17:19:26.568290 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c25a960f-f90f-453e-aeaf-455d4725027e req-d695fa41-e0b5-4c18-9612-726d4a5bcba4 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0508454 Nov 11 17:19:27.686346 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14342dd4-d3ad-4b0d-ac72-8059f088628d req-3472b39e-8ab8-4754-bd01-72e59a12b7f7 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:27.687838 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-14342dd4-d3ad-4b0d-ac72-8059f088628d req-3472b39e-8ab8-4754-bd01-72e59a12b7f7 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0496867 Nov 11 17:19:27.736121 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-14342dd4-d3ad-4b0d-ac72-8059f088628d req-56f27077-2794-4af3-8180-70e33d9f74ca tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417883 Nov 11 17:19:28.851603 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5efc077-26b9-4df0-9500-90122d2a403e req-232b547f-3d3b-4608-afd8-938e7ed516f3 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:28.856811 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f5efc077-26b9-4df0-9500-90122d2a403e req-232b547f-3d3b-4608-afd8-938e7ed516f3 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0485833 Nov 11 17:19:28.899936 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f5efc077-26b9-4df0-9500-90122d2a403e req-8c7598b1-ec07-4304-b08a-1e2766db9f7c tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408735 Nov 11 17:19:30.025168 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f75df936-8ed8-4271-9b86-7a4b7b060271 req-c92bf9eb-8f2e-42b3-90b1-a50ecbd142fa tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:30.026687 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f75df936-8ed8-4271-9b86-7a4b7b060271 req-c92bf9eb-8f2e-42b3-90b1-a50ecbd142fa tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0558341 Nov 11 17:19:30.075003 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f75df936-8ed8-4271-9b86-7a4b7b060271 req-4db619e5-d76f-419f-9c99-fa1295ae2eed tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424039 Nov 11 17:19:30.968789 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-73e77c8c-2897-4cf9-88a5-b8ab53511c41 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:31.191487 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-499d0841-659d-4604-9faa-d378ef8d4db6 req-a3f252ad-9115-48f8-954a-9b5c73ea74dd tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:31.193534 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-499d0841-659d-4604-9faa-d378ef8d4db6 req-a3f252ad-9115-48f8-954a-9b5c73ea74dd tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0478799 Nov 11 17:19:31.244542 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-499d0841-659d-4604-9faa-d378ef8d4db6 req-10b196c2-32a5-4791-9adb-4e8542b0e5b9 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450232 Nov 11 17:19:32.357805 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9547bb54-0065-40f7-bf42-7ea65aa620d5 req-a0ed0d1a-380d-408b-a426-e2d8f883ee4d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:32.359223 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9547bb54-0065-40f7-bf42-7ea65aa620d5 req-a0ed0d1a-380d-408b-a426-e2d8f883ee4d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0481668 Nov 11 17:19:32.406820 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9547bb54-0065-40f7-bf42-7ea65aa620d5 req-30353af9-309d-4112-ae7e-827db9d66e05 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409479 Nov 11 17:19:33.471920 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-be7975cc-22d4-4748-b07f-5132d4d41eff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:33.555522 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6324ea4f-e52d-44a7-894e-b57b12c66226 req-6dacbec0-2c3a-441e-8a03-738fa4829282 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:33.557114 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6324ea4f-e52d-44a7-894e-b57b12c66226 req-6dacbec0-2c3a-441e-8a03-738fa4829282 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0592906 Nov 11 17:19:33.612508 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6324ea4f-e52d-44a7-894e-b57b12c66226 req-ffe2109f-3b0e-425f-8316-06719575501e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0490894 Nov 11 17:19:34.545552 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:34.730496 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e74bced7-3e9b-4dfc-bab8-742b94af4d56 req-f50064ba-4f05-413b-9f7d-e415ba6a9441 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:34.732012 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e74bced7-3e9b-4dfc-bab8-742b94af4d56 req-f50064ba-4f05-413b-9f7d-e415ba6a9441 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0478067 Nov 11 17:19:34.782033 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e74bced7-3e9b-4dfc-bab8-742b94af4d56 req-aba560e9-53d8-4748-bede-f4a86af58917 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441329 Nov 11 17:19:35.138980 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:19:35.901607 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-239f967c-b976-4b16-b67d-d4ab6a0681d1 req-513c6f56-6c22-4738-9b2b-1c7eabbbdf67 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:35.903086 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-239f967c-b976-4b16-b67d-d4ab6a0681d1 req-513c6f56-6c22-4738-9b2b-1c7eabbbdf67 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0485644 Nov 11 17:19:35.949729 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-239f967c-b976-4b16-b67d-d4ab6a0681d1 req-54d09089-d9f8-4aa1-9bc1-9a1c0f7c56b3 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407977 Nov 11 17:19:36.368423 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:37.008873 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:37.073243 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-416ca752-1ac5-4766-8870-16faeec97b26 req-9817d30b-4f66-4993-bc13-6f4c7c4908d8 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:37.074738 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-416ca752-1ac5-4766-8870-16faeec97b26 req-9817d30b-4f66-4993-bc13-6f4c7c4908d8 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0499835 Nov 11 17:19:37.123290 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-416ca752-1ac5-4766-8870-16faeec97b26 req-35547cf6-9d4d-44ca-b62b-6a77e544da70 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425894 Nov 11 17:19:38.242656 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004a2a95-d273-4528-ab89-8e4288e27be8 req-a6bbc387-6b86-4a35-a6fc-58130b5b575e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:38.244149 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-004a2a95-d273-4528-ab89-8e4288e27be8 req-a6bbc387-6b86-4a35-a6fc-58130b5b575e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0529408 Nov 11 17:19:38.295080 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-004a2a95-d273-4528-ab89-8e4288e27be8 req-c9d16c47-3bc1-4a04-ae57-4d9c5829447b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444741 Nov 11 17:19:39.413025 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f95efca-498b-4da6-a612-fe5075d3fd94 req-e493ed41-a124-42cc-9358-57cee2b314f8 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:39.414437 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1f95efca-498b-4da6-a612-fe5075d3fd94 req-e493ed41-a124-42cc-9358-57cee2b314f8 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0501583 Nov 11 17:19:39.464500 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1f95efca-498b-4da6-a612-fe5075d3fd94 req-bffcb4d3-5bab-41e1-bbde-84159f04d8dd tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441148 Nov 11 17:19:40.584134 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81bf78b5-7f02-4f53-9444-44d7682ba7c9 req-3dddc717-68e1-4c3f-92ee-ce6156326ad5 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:40.585618 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-81bf78b5-7f02-4f53-9444-44d7682ba7c9 req-3dddc717-68e1-4c3f-92ee-ce6156326ad5 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0518289 Nov 11 17:19:40.632347 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-81bf78b5-7f02-4f53-9444-44d7682ba7c9 req-bccc55f5-b1fb-4645-b818-dfcfe2765b84 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408762 Nov 11 17:19:41.076776 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-551fce07-4249-4270-98a0-9f242aa81e88 req-532c2cd9-69ff-4503-9480-679a2674e4c6 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:41.078379 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-551fce07-4249-4270-98a0-9f242aa81e88 req-532c2cd9-69ff-4503-9480-679a2674e4c6 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0532119 Nov 11 17:19:41.133531 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-551fce07-4249-4270-98a0-9f242aa81e88 req-a052fce7-56f4-41a6-ad37-8f1368461de2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0481718 Nov 11 17:19:41.245888 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d24012b-b492-4e45-864a-b8216bb7f733 req-0684568c-b079-4e3a-a4e5-982946dde917 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:41.247434 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7d24012b-b492-4e45-864a-b8216bb7f733 req-0684568c-b079-4e3a-a4e5-982946dde917 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=7e951c2eae284261a98b317ec84140db&device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 1098 time: 0.0926588 Nov 11 17:19:41.336812 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d24012b-b492-4e45-864a-b8216bb7f733 req-077499c2-a0b7-4efb-9b66-9c43922f4219 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:41.338272 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7d24012b-b492-4e45-864a-b8216bb7f733 req-077499c2-a0b7-4efb-9b66-9c43922f4219 service neutron] 10.222.0.10 "GET /v2.0/networks?id=10ac93d3-f14d-4df5-a044-d683e35c1ab8 HTTP/1.1" status: 200 len: 912 time: 0.0831788 Nov 11 17:19:41.419078 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7d24012b-b492-4e45-864a-b8216bb7f733 req-a7f76459-7979-43f7-a75b-541cdb18edc6 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 HTTP/1.1" status: 200 len: 1001 time: 0.0698404 Nov 11 17:19:41.469504 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d24012b-b492-4e45-864a-b8216bb7f733 req-0414dbca-4391-473b-9458-d658b2ae8202 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:41.471216 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7d24012b-b492-4e45-864a-b8216bb7f733 req-0414dbca-4391-473b-9458-d658b2ae8202 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba HTTP/1.1" status: 200 len: 850 time: 0.0428355 Nov 11 17:19:41.515235 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d24012b-b492-4e45-864a-b8216bb7f733 req-a0c10d4b-28f1-4fa3-99bd-204a4a3d6039 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:41.516599 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7d24012b-b492-4e45-864a-b8216bb7f733 req-a0c10d4b-28f1-4fa3-99bd-204a4a3d6039 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=10ac93d3-f14d-4df5-a044-d683e35c1ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0386498 Nov 11 17:19:41.610192 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7d24012b-b492-4e45-864a-b8216bb7f733 req-0ef7640d-016d-4993-a8aa-abe73cad001b service neutron] 10.222.0.10 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859509 Nov 11 17:19:41.700138 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7d24012b-b492-4e45-864a-b8216bb7f733 req-215e3314-4b97-4342-ace2-9d9481396830 service neutron] 10.222.0.10 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0818183 Nov 11 17:19:42.253578 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a461ac-33f6-42b2-bfd3-9808d0518b79 req-6e126227-95c2-48c7-a626-b351b4fd03bf tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:42.255155 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-32a461ac-33f6-42b2-bfd3-9808d0518b79 req-6e126227-95c2-48c7-a626-b351b4fd03bf tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0503235 Nov 11 17:19:42.305066 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-32a461ac-33f6-42b2-bfd3-9808d0518b79 req-095be733-e250-4836-af5b-b1fabef86c30 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439472 Nov 11 17:19:42.424647 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7972bb18-741b-409c-ab3a-77bbe8b91041 req-b28c8dfd-4994-4f4c-889f-f7d226311052 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:42.426179 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7972bb18-741b-409c-ab3a-77bbe8b91041 req-b28c8dfd-4994-4f4c-889f-f7d226311052 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0563567 Nov 11 17:19:42.475796 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7972bb18-741b-409c-ab3a-77bbe8b91041 req-da7ef156-344b-4d8e-820b-9d45da8ac156 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428946 Nov 11 17:19:43.443250 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2bba48-1e5e-4de7-9e5e-829b49e6df08 req-68e70baa-0a54-4998-ae43-97ae045c63f0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:43.444784 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8a2bba48-1e5e-4de7-9e5e-829b49e6df08 req-68e70baa-0a54-4998-ae43-97ae045c63f0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0555060 Nov 11 17:19:43.495635 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8a2bba48-1e5e-4de7-9e5e-829b49e6df08 req-373e8458-4fec-4c75-8371-8c2ad001d45a tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446651 Nov 11 17:19:43.599905 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4827c54-369c-46d2-9486-6356059ce830 req-7e73cb55-02d8-43f7-892f-37b032ef3142 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:43.601400 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b4827c54-369c-46d2-9486-6356059ce830 req-7e73cb55-02d8-43f7-892f-37b032ef3142 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0511906 Nov 11 17:19:43.648627 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b4827c54-369c-46d2-9486-6356059ce830 req-399c69e7-02d4-4e26-9f7c-730d76ef39cd tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413158 Nov 11 17:19:44.775654 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7eecca8-fa93-42a5-b0f6-a087873dbe7e req-9ef4cf29-0e81-4f71-b549-8ebd731c51ac tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:44.777093 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c7eecca8-fa93-42a5-b0f6-a087873dbe7e req-9ef4cf29-0e81-4f71-b549-8ebd731c51ac tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0568388 Nov 11 17:19:44.822882 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c7eecca8-fa93-42a5-b0f6-a087873dbe7e req-fa113e5c-2c0c-4261-876b-d45156ae15f9 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394983 Nov 11 17:19:45.953373 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c55224c3-b62a-4641-bfcf-3b86ac7c3e6d req-965ec6e8-4fd4-4f0c-b417-a957d6956b54 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:45.954988 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c55224c3-b62a-4641-bfcf-3b86ac7c3e6d req-965ec6e8-4fd4-4f0c-b417-a957d6956b54 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0551333 Nov 11 17:19:46.011105 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c55224c3-b62a-4641-bfcf-3b86ac7c3e6d req-3c20d014-9a0f-411e-a4c1-009e37146b7e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0500674 Nov 11 17:19:46.762026 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6db7e98c-9e7f-495c-a459-c0556b2d22f4 req-cde10f3b-5fb2-4d8a-94cc-c8507634ee8d tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:46.763516 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6db7e98c-9e7f-495c-a459-c0556b2d22f4 req-cde10f3b-5fb2-4d8a-94cc-c8507634ee8d tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 945 time: 0.0495422 Nov 11 17:19:46.814171 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6db7e98c-9e7f-495c-a459-c0556b2d22f4 req-1931c6d5-1f7f-4586-911b-c070f8cb144c tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445983 Nov 11 17:19:46.858416 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:47.133931 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60b28e63-bb28-4498-8783-4e75184df4e5 req-ec141f3b-d7d1-4133-854b-3bdff352a734 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:47.135445 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-60b28e63-bb28-4498-8783-4e75184df4e5 req-ec141f3b-d7d1-4133-854b-3bdff352a734 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0492418 Nov 11 17:19:47.182597 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-60b28e63-bb28-4498-8783-4e75184df4e5 req-e7ecbaf6-2de4-45aa-b83b-b264422e1713 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412128 Nov 11 17:19:47.931478 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef82813b-647f-4d5e-ac1b-39aeff688383 req-1a538d9f-4233-4358-a727-61ef24a46efc tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:47.933138 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ef82813b-647f-4d5e-ac1b-39aeff688383 req-1a538d9f-4233-4358-a727-61ef24a46efc tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 945 time: 0.0508494 Nov 11 17:19:47.985079 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ef82813b-647f-4d5e-ac1b-39aeff688383 req-f66b03a1-e685-4725-ba38-7a02f20d436c tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457397 Nov 11 17:19:48.315972 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-756504c9-45da-4c27-8337-e88f26c8a0da req-9d301680-e4d8-4452-a8e6-8163b4a4f54e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:48.317580 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-756504c9-45da-4c27-8337-e88f26c8a0da req-9d301680-e4d8-4452-a8e6-8163b4a4f54e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0591204 Nov 11 17:19:48.387428 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e590e86-fc36-4f62-890f-a2ccd5c4dc56 req-79e0374f-4aa1-48a7-9359-cd59ece267e9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:48.389111 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1e590e86-fc36-4f62-890f-a2ccd5c4dc56 req-79e0374f-4aa1-48a7-9359-cd59ece267e9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.10 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 945 time: 0.0573263 Nov 11 17:19:48.489026 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-1e590e86-fc36-4f62-890f-a2ccd5c4dc56 req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Deleting port 187c87f3-1a3e-48da-b88a-46d1ee4144ea {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:19:48.489271 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-1e590e86-fc36-4f62-890f-a2ccd5c4dc56 req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:48.587345 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-1e590e86-fc36-4f62-890f-a2ccd5c4dc56 req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] For port 187c87f3-1a3e-48da-b88a-46d1ee4144ea, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=187c87f3-1a3e-48da-b88a-46d1ee4144ea,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:19:48.587705 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-1e590e86-fc36-4f62-890f-a2ccd5c4dc56 req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:48.631048 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-756504c9-45da-4c27-8337-e88f26c8a0da req-40034a06-99d8-48b9-bc7f-34af0203f448 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3065612 Nov 11 17:19:48.872925 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-1e590e86-fc36-4f62-890f-a2ccd5c4dc56 req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:48.873278 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-1e590e86-fc36-4f62-890f-a2ccd5c4dc56 req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:48.873585 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.l3_db [req-1e590e86-fc36-4f62-890f-a2ccd5c4dc56 req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Floating IP ba992ca3-6bc4-4506-b0c1-1099a040a0fb disassociated. External IP: 172.27.1.254, port: 187c87f3-1a3e-48da-b88a-46d1ee4144ea. Nov 11 17:19:48.873920 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-1e590e86-fc36-4f62-890f-a2ccd5c4dc56 req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Calling delete_port for 187c87f3-1a3e-48da-b88a-46d1ee4144ea owned by compute:nova {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:19:49.063183 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-1e590e86-fc36-4f62-890f-a2ccd5c4dc56 req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:49.104958 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a97987e6-dd82-48d8-8d0c-b2b813a0593b req-82ac92f1-d986-4e14-a15a-97c643514623 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 210 time: 0.0518882 Nov 11 17:19:49.107883 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event deleted for resources: {'Port': ['ID=187c87f3-1a3e-48da-b88a-46d1ee4144ea,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:19:49.118210 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:49.118658 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:49.119007 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:49.119344 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:49.119674 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:49.120002 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:49.120469 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:49.120803 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:49.121209 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:49.121879 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:49.121879 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:49.122125 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:19:49.235993 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [req-1e590e86-fc36-4f62-890f-a2ccd5c4dc56 req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Router 1267b92b-e259-4df2-9704-b862470a9e03 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:19:49.340365 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-1e590e86-fc36-4f62-890f-a2ccd5c4dc56 req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:19:49.350433 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f912f16a-3a86-4ec1-959e-525aa6844172 None None] Sync routers for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:19:49.360048 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f912f16a-3a86-4ec1-959e-525aa6844172 None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:19:49.360679 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-f912f16a-3a86-4ec1-959e-525aa6844172 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:19:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:19:49.383624 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-1e590e86-fc36-4f62-890f-a2ccd5c4dc56 req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] No DVR routers for this DVR port 187c87f3-1a3e-48da-b88a-46d1ee4144ea on host hv-cinder-69414 {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:19:49.389576 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-1e590e86-fc36-4f62-890f-a2ccd5c4dc56 req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:49.389772 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1e590e86-fc36-4f62-890f-a2ccd5c4dc56 req-3e8aba0d-9ea3-42f8-a906-3eccc6298660 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.10 "DELETE /v2.0/ports/187c87f3-1a3e-48da-b88a-46d1ee4144ea HTTP/1.1" status: 204 len: 173 time: 0.9936421 Nov 11 17:19:49.390172 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0d252f56-dd95-4edc-b002-65db4d8fc4d8', 'name': 'network-vif-deleted', 'tag': '187c87f3-1a3e-48da-b88a-46d1ee4144ea'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:19:49.392415 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f261ae2e-cc94-45e2-96de-b546f31b2e21" -d '{"events": [{"server_uuid": "0d252f56-dd95-4edc-b002-65db4d8fc4d8", "name": "network-vif-deleted", "tag": "187c87f3-1a3e-48da-b88a-46d1ee4144ea"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:19:49.506308 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:19:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-526a251e-22ba-415f-abe3-af43a50e1b44 x-openstack-request-id: req-526a251e-22ba-415f-abe3-af43a50e1b44 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:19:49.506624 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0d252f56-dd95-4edc-b002-65db4d8fc4d8", "name": "network-vif-deleted", "tag": "187c87f3-1a3e-48da-b88a-46d1ee4144ea", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:19:49.506907 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-526a251e-22ba-415f-abe3-af43a50e1b44 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:19:49.507306 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0d252f56-dd95-4edc-b002-65db4d8fc4d8', 'name': 'network-vif-deleted', 'tag': '187c87f3-1a3e-48da-b88a-46d1ee4144ea', 'status': 'completed', 'code': 200} Nov 11 17:19:49.623300 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-f912f16a-3a86-4ec1-959e-525aa6844172 None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:19:49.761292 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46e8a9bd-8d5a-4cdd-829f-6bf41cbf2670 req-6d2018c6-65eb-4c37-b847-e39158f9b3e0 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:49.762802 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-46e8a9bd-8d5a-4cdd-829f-6bf41cbf2670 req-6d2018c6-65eb-4c37-b847-e39158f9b3e0 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0610957 Nov 11 17:19:49.815452 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-46e8a9bd-8d5a-4cdd-829f-6bf41cbf2670 req-b36d5486-41fd-4f8f-8a27-eec4e250d0eb tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462885 Nov 11 17:19:49.842864 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-f912f16a-3a86-4ec1-959e-525aa6844172 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:19:49.869802 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f912f16a-3a86-4ec1-959e-525aa6844172 None None] Checking router: 1267b92b-e259-4df2-9704-b862470a9e03 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:19:49.878263 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f912f16a-3a86-4ec1-959e-525aa6844172 None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:19:49.879448 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-f912f16a-3a86-4ec1-959e-525aa6844172 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:19:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:19:49.987145 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-f912f16a-3a86-4ec1-959e-525aa6844172 None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:19:50.196026 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-f912f16a-3a86-4ec1-959e-525aa6844172 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:19:50.215333 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-353ebd46-8d88-4d86-8dce-c5b78031e2a4 req-6c3fcb05-5ec9-4c2d-bdc1-fcbceb2b878b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=0d252f56-dd95-4edc-b002-65db4d8fc4d8 HTTP/1.1" status: 200 len: 210 time: 0.0266240 Nov 11 17:19:50.223463 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f912f16a-3a86-4ec1-959e-525aa6844172 None None] The sync data for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi is: [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:19:50.432878 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9370d758-572d-400e-afec-0b137500c7ce None None] New status for floating IP ba992ca3-6bc4-4506-b0c1-1099a040a0fb: DOWN {{(pid=102326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:19:50.609026 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 187c87f3-1a3e-48da-b88a-46d1ee4144ea no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:19:50.629763 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: 187c87f3-1a3e-48da-b88a-46d1ee4144ea {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:19:50.630108 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 187c87f3-1a3e-48da-b88a-46d1ee4144ea not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:19:50.951284 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eede7b42-314f-414d-b4fc-15092ccb6ce2 req-0814f3d4-0350-4641-b6b7-0ac4c31769d4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:50.952884 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-eede7b42-314f-414d-b4fc-15092ccb6ce2 req-0814f3d4-0350-4641-b6b7-0ac4c31769d4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0502491 Nov 11 17:19:51.007762 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-eede7b42-314f-414d-b4fc-15092ccb6ce2 req-15949488-45d1-44e3-ae3e-d64be715d2dc tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0475614 Nov 11 17:19:51.469501 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-e0a5cd19-c287-40e2-9249-f925cdac8dc4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1848309604&fields=id&tenant_id=10bedfb35d1e481aa78e025489c1be2d HTTP/1.1" status: 200 len: 267 time: 0.0424483 Nov 11 17:19:51.573129 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-db7de17e-5d28-4b2c-8525-3a3a1701eedc tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:51.574567 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-db7de17e-5d28-4b2c-8525-3a3a1701eedc tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/networks?id=45e6626a-2007-490b-a445-d7c3baea689e HTTP/1.1" status: 200 len: 811 time: 0.0974607 Nov 11 17:19:51.590725 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-ee1b09c4-deab-4ac6-bae4-72bdecb5b0f9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/quotas/10bedfb35d1e481aa78e025489c1be2d HTTP/1.1" status: 200 len: 375 time: 0.0100195 Nov 11 17:19:51.647395 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-258ee946-6674-4c10-8e62-4379a6f0b43c tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0508494 Nov 11 17:19:51.783788 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-51fcdfa6-35aa-44cb-8f35-7957b936684d service neutron] 10.222.0.16 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1249521 Nov 11 17:19:51.881988 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-5e81f79d-2471-42e5-bce4-d67f01c51df0 service neutron] 10.222.0.16 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0915842 Nov 11 17:19:52.130056 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e6a145f-adf1-447f-b46c-2cb148bcfb19 req-348c8ba6-9b06-48e3-8846-5f3c6c25d3e0 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:52.131620 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5e6a145f-adf1-447f-b46c-2cb148bcfb19 req-348c8ba6-9b06-48e3-8846-5f3c6c25d3e0 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0513253 Nov 11 17:19:52.181050 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5e6a145f-adf1-447f-b46c-2cb148bcfb19 req-b3a80ce6-03d3-4a41-aa2a-d8249609f9d9 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434611 Nov 11 17:19:52.480033 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-17ac0a39-0d60-481a-8b32-29bdfaf9a86b req-bdd55e02-6cf7-4fc8-a4bd-150e0517ea54 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 210 time: 0.0295630 Nov 11 17:19:53.306894 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa21c959-3787-41e0-b5a5-a718942d0965 req-82a8d226-b9d1-45e0-abb8-b6d245d667c3 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:53.308534 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-fa21c959-3787-41e0-b5a5-a718942d0965 req-82a8d226-b9d1-45e0-abb8-b6d245d667c3 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0518255 Nov 11 17:19:53.362084 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-fa21c959-3787-41e0-b5a5-a718942d0965 req-b94755fb-b971-4c11-b335-5a1cc668f288 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470364 Nov 11 17:19:53.585140 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b3b93253-0368-4e9d-8998-2cfccc778482 req-2177b257-73b8-4c22-a903-0373f5127073 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 210 time: 0.0273044 Nov 11 17:19:54.540913 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdc729b6-a86e-4830-803a-6075e88d226a req-e80e3313-ae27-436a-babd-b6cd435b58c4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:54.542469 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cdc729b6-a86e-4830-803a-6075e88d226a req-e80e3313-ae27-436a-babd-b6cd435b58c4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.1046710 Nov 11 17:19:54.604667 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-22e882a9-2567-4384-b504-5ea0de533601 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:54.606109 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-22e882a9-2567-4384-b504-5ea0de533601 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.10 "GET /v2.0/networks?id=45e6626a-2007-490b-a445-d7c3baea689e HTTP/1.1" status: 200 len: 811 time: 0.1378996 Nov 11 17:19:54.621864 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cdc729b6-a86e-4830-803a-6075e88d226a req-41bb8345-8bfb-4c78-8721-bd1427d8e54e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0695846 Nov 11 17:19:54.680277 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-3b36569a-d03d-4e25-9c1b-0836dbaf95d2 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=10bedfb35d1e481aa78e025489c1be2d HTTP/1.1" status: 200 len: 380 time: 0.0563641 Nov 11 17:19:54.688820 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4f923e6d-359b-4492-acd0-cb9dff784498 req-51b265a5-2989-4cb9-b518-11215592da6e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 210 time: 0.0259292 Nov 11 17:19:54.692800 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-fddb2c82-1185-4ea9-9ff6-b10575e0e08f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Request body: {'port': {'device_id': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'admin_state_up': True, 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'security_groups': ['a3fcdc84-afa7-461b-8091-b146ab222f62']}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:19:54.836300 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-fddb2c82-1185-4ea9-9ff6-b10575e0e08f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Made reservation on behalf of 10bedfb35d1e481aa78e025489c1be2d for: {'port': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:19:54.839985 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-fddb2c82-1185-4ea9-9ff6-b10575e0e08f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:54.971308 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-fddb2c82-1185-4ea9-9ff6-b10575e0e08f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Allocated IP 172.20.0.7 (45e6626a-2007-490b-a445-d7c3baea689e/bf78c82f-f2f3-4ef7-8052-be816dbd2df8/5d28ea1f-ba26-4f7e-93e2-89690070a29f) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:19:55.110405 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-fddb2c82-1185-4ea9-9ff6-b10575e0e08f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:55.208085 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-fddb2c82-1185-4ea9-9ff6-b10575e0e08f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:55.256782 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-fddb2c82-1185-4ea9-9ff6-b10575e0e08f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Network 45e6626a-2007-490b-a445-d7c3baea689e is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:19:55.259931 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-fddb2c82-1185-4ea9-9ff6-b10575e0e08f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:19:55.264502 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-fddb2c82-1185-4ea9-9ff6-b10575e0e08f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:19:55.268490 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fddb2c82-1185-4ea9-9ff6-b10575e0e08f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event updated for resources: {'Port': ['ID=5d28ea1f-ba26-4f7e-93e2-89690070a29f,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:19:55.322563 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-fddb2c82-1185-4ea9-9ff6-b10575e0e08f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:55.323237 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-fddb2c82-1185-4ea9-9ff6-b10575e0e08f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:55.399428 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-fddb2c82-1185-4ea9-9ff6-b10575e0e08f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7121501 Nov 11 17:19:55.413940 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Request body: {'port': {'device_id': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:19:55.467677 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:55.492219 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-c3686a44-eb18-421c-b8d7-42960ebabab1 None None] Provisioning complete for port 5d28ea1f-ba26-4f7e-93e2-89690070a29f triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:19:55.492801 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c3686a44-eb18-421c-b8d7-42960ebabab1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:55.538166 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-c3686a44-eb18-421c-b8d7-42960ebabab1 None None] Port 5d28ea1f-ba26-4f7e-93e2-89690070a29f cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:19:55.811444 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf9b85da-ac94-4866-9851-e82e30e8803a req-f1aa7e35-6ed5-45ed-8c80-9a924235ab4f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:55.812902 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-bf9b85da-ac94-4866-9851-e82e30e8803a req-f1aa7e35-6ed5-45ed-8c80-9a924235ab4f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 931 time: 0.0511680 Nov 11 17:19:55.866225 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-bf9b85da-ac94-4866-9851-e82e30e8803a req-4d119f68-66d0-4c4e-9524-fb5b6827fb9b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469992 Nov 11 17:19:55.937805 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fab20af-3a27-40e9-a45a-7eb6d1c13b9c req-ac70b384-9002-49c2-850b-8c57199c1d10 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:55.939278 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8fab20af-3a27-40e9-a45a-7eb6d1c13b9c req-ac70b384-9002-49c2-850b-8c57199c1d10 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.1059420 Nov 11 17:19:56.019835 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8fab20af-3a27-40e9-a45a-7eb6d1c13b9c req-3abbc158-59dc-4ee2-848d-6f44a52b3364 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0729368 Nov 11 17:19:56.054273 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5d28ea1f-ba26-4f7e-93e2-89690070a29f {{(pid=102324) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:19:56.061760 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:56.073230 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.provisioning_blocks [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Transition to ACTIVE for port object 5d28ea1f-ba26-4f7e-93e2-89690070a29f will not be triggered until provisioned by entity L2. {{(pid=102324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:19:56.138792 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:56.187633 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Pushing event updated for resources: {'Port': ['ID=5d28ea1f-ba26-4f7e-93e2-89690070a29f,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:19:56.263092 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Attempting to bind port 5d28ea1f-ba26-4f7e-93e2-89690070a29f on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:19:56.263421 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Attempting to bind port 5d28ea1f-ba26-4f7e-93e2-89690070a29f by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:19:56.263747 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Attempting to bind port 5d28ea1f-ba26-4f7e-93e2-89690070a29f on network 45e6626a-2007-490b-a445-d7c3baea689e {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:19:56.268558 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Port 5d28ea1f-ba26-4f7e-93e2-89690070a29f on network 45e6626a-2007-490b-a445-d7c3baea689e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:19:56.268875 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Attempting to bind port 5d28ea1f-ba26-4f7e-93e2-89690070a29f on network 45e6626a-2007-490b-a445-d7c3baea689e {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:19:56.274142 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 19, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:19:56.274640 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Checking segment: {'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:19:56.275022 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Bound using segment: {'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:19:56.275461 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Bound port: 5d28ea1f-ba26-4f7e-93e2-89690070a29f, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'}}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:19:56.276429 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:56.340644 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] For port 5d28ea1f-ba26-4f7e-93e2-89690070a29f, host hv-cinder-69414, cleared binding levels {{(pid=102324) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:19:56.343628 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] For port 5d28ea1f-ba26-4f7e-93e2-89690070a29f, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5d28ea1f-ba26-4f7e-93e2-89690070a29f,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102324) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:19:56.402429 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:56.436784 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:56.437396 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:19:56.438827 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] 10.222.0.10 "PUT /v2.0/ports/5d28ea1f-ba26-4f7e-93e2-89690070a29f HTTP/1.1" status: 200 len: 1093 time: 1.0292182 Nov 11 17:19:56.439263 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'tag': '5d28ea1f-ba26-4f7e-93e2-89690070a29f'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:19:56.441387 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-75489f73-bb26-421b-a2ca-e42842157016" -d '{"events": [{"name": "network-changed", "server_uuid": "08f1424d-ebf2-4f7e-aeb0-f24dcec12607", "tag": "5d28ea1f-ba26-4f7e-93e2-89690070a29f"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:19:56.467126 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a19171c2-547a-4ed7-96bf-7200f71d7a1d service neutron] Pushing event updated for resources: {'Port': ['ID=5d28ea1f-ba26-4f7e-93e2-89690070a29f,revision_number=3']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:19:56.488679 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:19:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0cf77af6-6390-442a-a39f-8c50ab0c8fca x-openstack-request-id: req-0cf77af6-6390-442a-a39f-8c50ab0c8fca {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:19:56.488969 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "08f1424d-ebf2-4f7e-aeb0-f24dcec12607", "tag": "5d28ea1f-ba26-4f7e-93e2-89690070a29f", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:19:56.489217 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-0cf77af6-6390-442a-a39f-8c50ab0c8fca {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:19:56.489638 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'tag': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'status': 'completed', 'code': 200} Nov 11 17:19:56.561114 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75489f73-bb26-421b-a2ca-e42842157016 req-dfa68f2a-94ec-4d96-9c6f-2123afda5474 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:56.562717 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-75489f73-bb26-421b-a2ca-e42842157016 req-dfa68f2a-94ec-4d96-9c6f-2123afda5474 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 1096 time: 0.0470347 Nov 11 17:19:56.673559 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75489f73-bb26-421b-a2ca-e42842157016 req-f5b8df6a-c96c-4cdd-a1fb-2c517fdedbb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:56.675104 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-75489f73-bb26-421b-a2ca-e42842157016 req-f5b8df6a-c96c-4cdd-a1fb-2c517fdedbb8 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=10bedfb35d1e481aa78e025489c1be2d&shared=False HTTP/1.1" status: 200 len: 912 time: 0.1040497 Nov 11 17:19:56.777936 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75489f73-bb26-421b-a2ca-e42842157016 req-ac7cb260-8e41-4bf8-86b8-7f32b6aab62e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:56.779419 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-75489f73-bb26-421b-a2ca-e42842157016 req-ac7cb260-8e41-4bf8-86b8-7f32b6aab62e service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0945606 Nov 11 17:19:56.859436 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-286d4f31-5fae-4271-ba55-491325234c7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:56.860813 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-286d4f31-5fae-4271-ba55-491325234c7d service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 1096 time: 0.0409956 Nov 11 17:19:56.903948 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-3d4b7717-bd85-43b2-b677-d403db1892e5 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5d28ea1f-ba26-4f7e-93e2-89690070a29f HTTP/1.1" status: 200 len: 217 time: 0.0335464 Nov 11 17:19:56.987898 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-368a440d-dc6b-4313-ab7d-279fd167429a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:56.989442 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-368a440d-dc6b-4313-ab7d-279fd167429a service neutron] 10.222.0.10 "GET /v2.0/subnets?id=bf78c82f-f2f3-4ef7-8052-be816dbd2df8 HTTP/1.1" status: 200 len: 850 time: 0.0780962 Nov 11 17:19:57.013682 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cfb6607-2bec-423a-b91f-226e8280e8d9 req-68b436ff-24fa-4ba7-b74c-b18cacb3b26f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:57.015202 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3cfb6607-2bec-423a-b91f-226e8280e8d9 req-68b436ff-24fa-4ba7-b74c-b18cacb3b26f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 943 time: 0.0711148 Nov 11 17:19:57.081285 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-58f52e5b-ef22-472c-abf5-6235e15f4cb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:57.083477 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-58f52e5b-ef22-472c-abf5-6235e15f4cb5 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=45e6626a-2007-490b-a445-d7c3baea689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0857871 Nov 11 17:19:57.092978 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3cfb6607-2bec-423a-b91f-226e8280e8d9 req-7ee75d1b-6541-495c-8f07-1150e3233248 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0573564 Nov 11 17:19:57.158567 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01408b88-6e58-477e-bf70-bd5a4acf79f5 req-3e26ee5a-1db1-4ef3-9f31-06370c59a87e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:57.160409 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-01408b88-6e58-477e-bf70-bd5a4acf79f5 req-3e26ee5a-1db1-4ef3-9f31-06370c59a87e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0626109 Nov 11 17:19:57.192584 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-0d4aa607-6313-4e53-90b6-3f662edfe997 service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0986190 Nov 11 17:19:57.212988 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-01408b88-6e58-477e-bf70-bd5a4acf79f5 req-6673cc45-c478-4655-9820-e709bacf4359 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451698 Nov 11 17:19:57.293268 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f48d0951-49cf-4b73-a6b9-ef0bc1f5a414 req-5272d4f4-6914-4dbf-99b8-d22c57ed5dcb service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0923014 Nov 11 17:19:58.215056 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03451e2e-396b-4c51-81bf-9fd433ad0a3f req-b605fc1e-9b9c-42f4-8dcb-40d9c9ed1730 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:58.216530 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-03451e2e-396b-4c51-81bf-9fd433ad0a3f req-b605fc1e-9b9c-42f4-8dcb-40d9c9ed1730 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 943 time: 0.0535321 Nov 11 17:19:58.266976 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-03451e2e-396b-4c51-81bf-9fd433ad0a3f req-61868b24-d46b-47ba-a8f1-fb4c825ee485 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441942 Nov 11 17:19:58.332724 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b3b2144-76a7-4baf-9601-f5049af762ad req-1e958873-b448-4e46-a031-00c8cff3857b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:58.334199 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5b3b2144-76a7-4baf-9601-f5049af762ad req-1e958873-b448-4e46-a031-00c8cff3857b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0487196 Nov 11 17:19:58.381721 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5b3b2144-76a7-4baf-9601-f5049af762ad req-97ad3c48-a2d6-4aab-8149-d3f6d92bd8db tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412743 Nov 11 17:19:59.380003 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b04b10a-e9c7-41ab-bb22-274055ec4752 req-4c358949-1779-447a-bf93-55fd24009a12 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:59.381489 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3b04b10a-e9c7-41ab-bb22-274055ec4752 req-4c358949-1779-447a-bf93-55fd24009a12 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 943 time: 0.0499775 Nov 11 17:19:59.431810 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3b04b10a-e9c7-41ab-bb22-274055ec4752 req-13b8ff4a-72de-4d25-8a52-2667e19872e4 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443740 Nov 11 17:19:59.499803 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-115d21d8-e85d-4ca6-9af2-18de09ea9cef req-a409927c-28ad-48de-8074-e68b19d17ee1 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:19:59.501988 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-115d21d8-e85d-4ca6-9af2-18de09ea9cef req-a409927c-28ad-48de-8074-e68b19d17ee1 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0486319 Nov 11 17:19:59.552094 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-115d21d8-e85d-4ca6-9af2-18de09ea9cef req-637cdf1a-f7eb-4d31-84eb-bdce5667f04f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443454 Nov 11 17:20:00.543023 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a1362c-c350-445c-b126-9b129b249efd req-746f1405-ee81-4028-8630-505603035208 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:00.544538 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c5a1362c-c350-445c-b126-9b129b249efd req-746f1405-ee81-4028-8630-505603035208 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 943 time: 0.0477302 Nov 11 17:20:00.598670 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c5a1362c-c350-445c-b126-9b129b249efd req-6ae51836-0abe-4ba5-b1d6-27739fe8a91a tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481491 Nov 11 17:20:00.679948 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dff5875a-452e-4ef0-9f9b-5737f5da8f9f req-7b2a46e2-4a2e-49be-ae09-219a89470d2c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:00.681431 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-dff5875a-452e-4ef0-9f9b-5737f5da8f9f req-7b2a46e2-4a2e-49be-ae09-219a89470d2c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0484493 Nov 11 17:20:00.728324 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-dff5875a-452e-4ef0-9f9b-5737f5da8f9f req-306e5db4-1391-4306-a463-999ba752e47f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409005 Nov 11 17:20:00.960813 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-42e39c6c-4c93-4df4-a1c5-e1a5ad3800fc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:01.712687 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ec08d27-d9e9-413e-aa36-98cd63361672 req-61885e66-28bf-4af1-a73e-6110d3868590 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:01.714428 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8ec08d27-d9e9-413e-aa36-98cd63361672 req-61885e66-28bf-4af1-a73e-6110d3868590 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 943 time: 0.0492857 Nov 11 17:20:01.766295 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8ec08d27-d9e9-413e-aa36-98cd63361672 req-f38cf039-bf55-469a-b817-c46818ad29e7 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455017 Nov 11 17:20:01.853222 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72a5d63f-b2ad-4e04-84dc-3e37c5135b99 req-e25de4ba-24c2-403c-abed-05bddfe48c4f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:01.854708 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-72a5d63f-b2ad-4e04-84dc-3e37c5135b99 req-e25de4ba-24c2-403c-abed-05bddfe48c4f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0506327 Nov 11 17:20:01.902219 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-72a5d63f-b2ad-4e04-84dc-3e37c5135b99 req-b8cb89bd-b347-4a9f-9f9b-48981a859837 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415180 Nov 11 17:20:02.880440 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae199cc8-708a-472a-9a12-bda5a9c48c39 req-8cebdb19-0106-422b-9cd1-506c6cccefa6 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:02.881904 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ae199cc8-708a-472a-9a12-bda5a9c48c39 req-8cebdb19-0106-422b-9cd1-506c6cccefa6 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 943 time: 0.0487857 Nov 11 17:20:02.936138 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ae199cc8-708a-472a-9a12-bda5a9c48c39 req-2a80097e-f429-49ce-ac66-4e12ff7e60c2 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475898 Nov 11 17:20:03.031227 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5689925e-4bd2-47f5-8f98-98acc6106096 req-7d0d444c-33aa-4547-85bc-7db7cc179efd tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:03.032721 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5689925e-4bd2-47f5-8f98-98acc6106096 req-7d0d444c-33aa-4547-85bc-7db7cc179efd tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0525331 Nov 11 17:20:03.079367 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5689925e-4bd2-47f5-8f98-98acc6106096 req-6b5a7230-6447-4c9b-89a6-88cc112ca597 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407681 Nov 11 17:20:03.515731 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fda9157b-587d-49a4-98a6-13f08f5f1ee2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:04.054346 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-347cb676-f529-4b7e-b4be-9db28defe171 req-1f2850bb-9416-45de-b03e-6c467060ea1e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:04.055831 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-347cb676-f529-4b7e-b4be-9db28defe171 req-1f2850bb-9416-45de-b03e-6c467060ea1e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 943 time: 0.0520105 Nov 11 17:20:04.104207 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-347cb676-f529-4b7e-b4be-9db28defe171 req-8522d7b1-2396-45c6-bffa-8fb77c0da998 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425768 Nov 11 17:20:04.196705 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a836d4a-70a6-496d-aa09-764c044d8cfc req-21656b4b-aabd-45d3-9591-590422638753 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:04.198183 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-3a836d4a-70a6-496d-aa09-764c044d8cfc req-21656b4b-aabd-45d3-9591-590422638753 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0483279 Nov 11 17:20:04.245704 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-3a836d4a-70a6-496d-aa09-764c044d8cfc req-3222f34f-40b2-45b6-b049-911cc7b4b09f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415261 Nov 11 17:20:04.584094 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:04.710892 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 5d28ea1f-ba26-4f7e-93e2-89690070a29f details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:20:04.823398 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 5d28ea1f-ba26-4f7e-93e2-89690070a29f, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5d28ea1f-ba26-4f7e-93e2-89690070a29f,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:20:04.834694 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'port_id': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'mac_address': 'fa:16:3e:b6:db:66', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 505, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:20:04.875478 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:04.889018 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5d28ea1f-ba26-4f7e-93e2-89690070a29f {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:20:04.908592 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 5d28ea1f-ba26-4f7e-93e2-89690070a29f, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5d28ea1f-ba26-4f7e-93e2-89690070a29f,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:20:04.978802 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:05.026352 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=5d28ea1f-ba26-4f7e-93e2-89690070a29f,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:20:05.033930 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:05.034301 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:05.034666 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:05.035001 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:05.035976 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:05.036355 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:05.036683 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:05.037008 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:05.037330 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:05.037652 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:05.037973 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:05.038286 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:05.222845 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e84ae7da-7038-453e-99be-771465abfe25 req-79457eb1-0839-432e-adca-3abd4ecc78c0 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:05.224328 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e84ae7da-7038-453e-99be-771465abfe25 req-79457eb1-0839-432e-adca-3abd4ecc78c0 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 944 time: 0.0498316 Nov 11 17:20:05.242515 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['5d28ea1f-ba26-4f7e-93e2-89690070a29f'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:20:05.277330 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e84ae7da-7038-453e-99be-771465abfe25 req-0c90ed0c-5b37-46c9-bf0b-8719b1f6444e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467086 Nov 11 17:20:05.367134 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c81bc2b-c51a-49dc-b492-6d708b021867 req-0b6f60e6-0d53-4e24-b284-30548f7b95a6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:05.368699 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0c81bc2b-c51a-49dc-b492-6d708b021867 req-0b6f60e6-0d53-4e24-b284-30548f7b95a6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0499721 Nov 11 17:20:05.422456 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0c81bc2b-c51a-49dc-b492-6d708b021867 req-e3bad460-8d8f-403a-aa0d-8fe3a5fa6812 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471330 Nov 11 17:20:06.315537 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:06.392687 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f757922-6650-4d70-abfc-522c0488fb03 req-23457498-e5dd-4efd-be6a-5eb001312635 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:06.394218 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8f757922-6650-4d70-abfc-522c0488fb03 req-23457498-e5dd-4efd-be6a-5eb001312635 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 944 time: 0.0477202 Nov 11 17:20:06.448782 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8f757922-6650-4d70-abfc-522c0488fb03 req-12919604-9235-44d5-a902-7b6351a2dc4d tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477798 Nov 11 17:20:06.545025 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27790e3c-a1ae-4ddb-b6cf-7ca906b8423f req-1990481b-09b4-4d63-93c8-3bfcc608281d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:06.546521 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-27790e3c-a1ae-4ddb-b6cf-7ca906b8423f req-1990481b-09b4-4d63-93c8-3bfcc608281d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0485811 Nov 11 17:20:06.594147 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-27790e3c-a1ae-4ddb-b6cf-7ca906b8423f req-cfabdbaf-4b2d-4ba5-9b78-62a1b497f81c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413339 Nov 11 17:20:06.711984 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 5d28ea1f-ba26-4f7e-93e2-89690070a29f up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:20:06.800884 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port 5d28ea1f-ba26-4f7e-93e2-89690070a29f completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:20:06.804820 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 5d28ea1f-ba26-4f7e-93e2-89690070a29f triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:20:06.805185 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:06.889224 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:06.912056 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5d28ea1f-ba26-4f7e-93e2-89690070a29f'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:20:06.914303 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-20c6f3b3-9742-4b01-9787-1887f7b53b15" -d '{"events": [{"server_uuid": "08f1424d-ebf2-4f7e-aeb0-f24dcec12607", "name": "network-vif-plugged", "status": "completed", "tag": "5d28ea1f-ba26-4f7e-93e2-89690070a29f"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:20:06.931507 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 5d28ea1f-ba26-4f7e-93e2-89690070a29f, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5d28ea1f-ba26-4f7e-93e2-89690070a29f,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:20:07.007385 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:07.014367 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:20:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1df2812b-ee31-41d6-853a-ebe199566b65 x-openstack-request-id: req-1df2812b-ee31-41d6-853a-ebe199566b65 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:20:07.014855 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "08f1424d-ebf2-4f7e-aeb0-f24dcec12607", "name": "network-vif-plugged", "status": "completed", "tag": "5d28ea1f-ba26-4f7e-93e2-89690070a29f", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:20:07.015026 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-1df2812b-ee31-41d6-853a-ebe199566b65 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:20:07.015323 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'code': 200} Nov 11 17:20:07.056152 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:07.060263 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=5d28ea1f-ba26-4f7e-93e2-89690070a29f,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:20:07.335569 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-182270d4-881b-42d7-ba26-b1bc4f282b00 req-e087914a-f1a8-413b-b7ec-17606720940f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:07.337057 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-182270d4-881b-42d7-ba26-b1bc4f282b00 req-e087914a-f1a8-413b-b7ec-17606720940f service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 1098 time: 0.0433943 Nov 11 17:20:07.387718 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-182270d4-881b-42d7-ba26-b1bc4f282b00 req-b65cb93e-350e-4dee-a210-bee8a3d16a22 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416827 Nov 11 17:20:07.571323 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-605840d0-b418-4b17-bd53-663bf326244e req-02359aa6-3bf7-4138-88be-e331c8d16f06 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:07.572707 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-605840d0-b418-4b17-bd53-663bf326244e req-02359aa6-3bf7-4138-88be-e331c8d16f06 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 945 time: 0.0505443 Nov 11 17:20:07.622625 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-605840d0-b418-4b17-bd53-663bf326244e req-87e32a35-878a-4e2d-ad1f-4d1813426bec tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440614 Nov 11 17:20:07.712699 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9605faa2-9ef9-401a-b9af-616a8c532b14 req-6ebaee2d-ecf0-4c88-b737-c9cf536c7eb0 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:07.714133 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9605faa2-9ef9-401a-b9af-616a8c532b14 req-6ebaee2d-ecf0-4c88-b737-c9cf536c7eb0 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0466902 Nov 11 17:20:07.760032 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9605faa2-9ef9-401a-b9af-616a8c532b14 req-e83c41de-9cf9-473f-8cc5-fb114108b755 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398848 Nov 11 17:20:08.744137 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58570b32-4a9a-4f7e-9781-44d0ced1fdd9 req-6156975d-3d19-49dd-ad5b-41f858697a38 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:08.745629 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-58570b32-4a9a-4f7e-9781-44d0ced1fdd9 req-6156975d-3d19-49dd-ad5b-41f858697a38 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 945 time: 0.0545964 Nov 11 17:20:08.796237 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-58570b32-4a9a-4f7e-9781-44d0ced1fdd9 req-aabe0a5d-83b8-42cc-acba-bc3861a9249d tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446067 Nov 11 17:20:08.890139 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b286d23-a0da-46ea-b215-49d562ddfca2 req-fc1525a0-0174-4147-b21d-11703ed24974 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:08.892057 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8b286d23-a0da-46ea-b215-49d562ddfca2 req-fc1525a0-0174-4147-b21d-11703ed24974 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0533965 Nov 11 17:20:08.925066 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-247f2d30-7264-464f-b8e0-f23d44021e53 req-cade3bb5-7ac7-4aa7-b7c0-cfce3f038300 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:08.927116 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-247f2d30-7264-464f-b8e0-f23d44021e53 req-cade3bb5-7ac7-4aa7-b7c0-cfce3f038300 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 945 time: 0.0506783 Nov 11 17:20:08.943451 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8b286d23-a0da-46ea-b215-49d562ddfca2 req-05471760-8cd4-4280-8967-a8a22b5b78c8 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452516 Nov 11 17:20:08.979453 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-247f2d30-7264-464f-b8e0-f23d44021e53 req-751d3abe-7275-482e-973e-22427f2bfd01 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462248 Nov 11 17:20:09.003054 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 34840) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:20:09.045785 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0f587e4-250c-422c-8f0e-a898ac728b18 tempest-TestVolumeBootPattern-934397991 tempest-TestVolumeBootPattern-934397991-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:09.047375 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-d0f587e4-250c-422c-8f0e-a898ac728b18 tempest-TestVolumeBootPattern-934397991 tempest-TestVolumeBootPattern-934397991-project-admin] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 1093 time: 0.0432260 Nov 11 17:20:09.050288 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 34842) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:20:09.055581 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Request body: {'floatingip': {'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'port_id': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address': '172.20.0.7'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:20:09.144158 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for floatingip, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:09.258388 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:09.367755 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Allocated IP 172.27.1.133 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/c814254e-6f6c-47b3-88fe-96b8e83aeaac) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:20:09.518803 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:09.630191 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:09.677585 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:20:09.682964 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:20:09.685552 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:20:09.688890 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event updated for resources: {'Port': ['ID=c814254e-6f6c-47b3-88fe-96b8e83aeaac,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:20:10.047058 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:10.064295 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef82202d-8a2b-4057-b84d-123e84360390 req-d2daec6d-0092-4237-b5e2-8e08702e3876 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:10.065774 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ef82202d-8a2b-4057-b84d-123e84360390 req-d2daec6d-0092-4237-b5e2-8e08702e3876 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0482795 Nov 11 17:20:10.113711 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ef82202d-8a2b-4057-b84d-123e84360390 req-d7ae4bb7-851e-4271-a41e-f1ba1b70436f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407946 Nov 11 17:20:10.180944 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:10.332713 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:10.418144 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:10.483688 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event updated for resources: {'Port': ['ID=c814254e-6f6c-47b3-88fe-96b8e83aeaac,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:20:10.495799 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:10.496135 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:10.496479 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:10.496817 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:10.497150 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:10.497484 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:10.497850 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:10.498181 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:10.498508 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:10.498864 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:10.499188 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:10.499508 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:20:10.508966 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:10.611467 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.l3_db [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Floating IP 98da0cbf-ec1c-4c72-a17d-c2c96671021e associated. External IP: 172.27.1.133, port: 5d28ea1f-ba26-4f7e-93e2-89690070a29f. Nov 11 17:20:10.821963 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Router 1267b92b-e259-4df2-9704-b862470a9e03 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:20:10.939111 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:20:10.948963 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7043d570-f3ac-4d8e-947c-7ed69b4379ef None None] Sync routers for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:20:10.959022 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7043d570-f3ac-4d8e-947c-7ed69b4379ef None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:20:10.965224 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-7043d570-f3ac-4d8e-947c-7ed69b4379ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:20:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:20:11.020565 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:11.048615 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-5ed24556-cdbf-401c-9f9e-b1e68c48d336 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.9963226 Nov 11 17:20:11.062898 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'tag': '5d28ea1f-ba26-4f7e-93e2-89690070a29f'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:20:11.062898 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e2a0417-374a-4ffc-baca-42f915ca9fc9" -d '{"events": [{"name": "network-changed", "server_uuid": "08f1424d-ebf2-4f7e-aeb0-f24dcec12607", "tag": "5d28ea1f-ba26-4f7e-93e2-89690070a29f"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:20:11.073720 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-7043d570-f3ac-4d8e-947c-7ed69b4379ef None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:20:11.152646 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:20:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5f184c96-6065-4291-b559-38465a08468d x-openstack-request-id: req-5f184c96-6065-4291-b559-38465a08468d {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:20:11.152937 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "08f1424d-ebf2-4f7e-aeb0-f24dcec12607", "tag": "5d28ea1f-ba26-4f7e-93e2-89690070a29f", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:20:11.153176 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-5f184c96-6065-4291-b559-38465a08468d {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:20:11.153570 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'tag': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'status': 'completed', 'code': 200} Nov 11 17:20:11.255210 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e2a0417-374a-4ffc-baca-42f915ca9fc9 req-4328164c-ad3c-489d-a5f1-33475a1a3ef7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:11.256789 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9e2a0417-374a-4ffc-baca-42f915ca9fc9 req-4328164c-ad3c-489d-a5f1-33475a1a3ef7 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 1098 time: 0.0769057 Nov 11 17:20:11.268007 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a6f529d-6a9a-40b0-86f0-36a2f62325af req-2a8013aa-3938-4e11-a10f-4a45040b35c4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:11.269548 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1a6f529d-6a9a-40b0-86f0-36a2f62325af req-2a8013aa-3938-4e11-a10f-4a45040b35c4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0782857 Nov 11 17:20:11.317044 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-7043d570-f3ac-4d8e-947c-7ed69b4379ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '98da0cbf-ec1c-4c72-a17d-c2c96671021e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'floating_ip_address': '172.27.1.133', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'port_id': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 542, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'mac_address': 'fa:16:3e:b6:db:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:20:09Z', 'updated_at': '2021-11-11T17:20:09Z', 'revision_number': 0, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:20:11.346516 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7043d570-f3ac-4d8e-947c-7ed69b4379ef None None] Checking router: 1267b92b-e259-4df2-9704-b862470a9e03 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:20:11.357196 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7043d570-f3ac-4d8e-947c-7ed69b4379ef None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:20:11.357822 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-7043d570-f3ac-4d8e-947c-7ed69b4379ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:20:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:20:11.378285 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1a6f529d-6a9a-40b0-86f0-36a2f62325af req-8556d4fb-2864-454a-86e7-a97566793b02 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1005375 Nov 11 17:20:11.403372 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e2a0417-374a-4ffc-baca-42f915ca9fc9 req-fb8cde34-d7cd-47a1-9ed0-ef0773c030ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:11.405459 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9e2a0417-374a-4ffc-baca-42f915ca9fc9 req-fb8cde34-d7cd-47a1-9ed0-ef0773c030ff service neutron] 10.222.0.10 "GET /v2.0/networks?id=45e6626a-2007-490b-a445-d7c3baea689e HTTP/1.1" status: 200 len: 912 time: 0.1350274 Nov 11 17:20:11.475613 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9e2a0417-374a-4ffc-baca-42f915ca9fc9 req-82677c4f-adb0-473e-a71a-0764f413a21a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5d28ea1f-ba26-4f7e-93e2-89690070a29f HTTP/1.1" status: 200 len: 999 time: 0.0621748 Nov 11 17:20:11.477545 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-7043d570-f3ac-4d8e-947c-7ed69b4379ef None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:20:11.530005 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e2a0417-374a-4ffc-baca-42f915ca9fc9 req-885ef8d6-c892-4951-ae49-84c5eeb882c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:11.531606 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9e2a0417-374a-4ffc-baca-42f915ca9fc9 req-885ef8d6-c892-4951-ae49-84c5eeb882c9 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=bf78c82f-f2f3-4ef7-8052-be816dbd2df8 HTTP/1.1" status: 200 len: 850 time: 0.0491986 Nov 11 17:20:11.596610 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e2a0417-374a-4ffc-baca-42f915ca9fc9 req-c48833eb-0766-4ff0-bdfe-66b33e156fea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:11.598168 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9e2a0417-374a-4ffc-baca-42f915ca9fc9 req-c48833eb-0766-4ff0-bdfe-66b33e156fea service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=45e6626a-2007-490b-a445-d7c3baea689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0498557 Nov 11 17:20:11.695649 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9e2a0417-374a-4ffc-baca-42f915ca9fc9 req-d24bdf4a-15a1-4c2f-81ae-3495ca4e82c5 service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0895138 Nov 11 17:20:11.734834 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-7043d570-f3ac-4d8e-947c-7ed69b4379ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '98da0cbf-ec1c-4c72-a17d-c2c96671021e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'floating_ip_address': '172.27.1.133', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'port_id': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 542, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'mac_address': 'fa:16:3e:b6:db:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:20:09Z', 'updated_at': '2021-11-11T17:20:09Z', 'revision_number': 0, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:20:11.762514 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7043d570-f3ac-4d8e-947c-7ed69b4379ef None None] The sync data for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi is: [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '98da0cbf-ec1c-4c72-a17d-c2c96671021e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'floating_ip_address': '172.27.1.133', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'port_id': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 542, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'mac_address': 'fa:16:3e:b6:db:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:20:09Z', 'updated_at': '2021-11-11T17:20:09Z', 'revision_number': 0, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:20:11.794710 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9e2a0417-374a-4ffc-baca-42f915ca9fc9 req-4ec6909f-e71c-4691-8a24-094244226ed6 service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0917625 Nov 11 17:20:11.939141 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eac9a556-251c-4a4d-b2ce-9e542de1e32e None None] New status for floating IP 98da0cbf-ec1c-4c72-a17d-c2c96671021e: ACTIVE {{(pid=102326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:20:12.137045 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:20:12.501314 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ca714da-ea3f-419a-94f2-4028530bd31d req-e966726f-aa5b-4cd2-92ff-bd9c6afe595e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:12.502831 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7ca714da-ea3f-419a-94f2-4028530bd31d req-e966726f-aa5b-4cd2-92ff-bd9c6afe595e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0493872 Nov 11 17:20:12.551122 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7ca714da-ea3f-419a-94f2-4028530bd31d req-893e799f-15e7-4c70-a6cf-445db7cb1597 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423927 Nov 11 17:20:13.672621 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46eb9063-d085-4d9e-89dc-b4320b182584 req-8fbb0a9b-4a2e-4fc0-9c41-8e931058c4c8 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:13.674106 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-46eb9063-d085-4d9e-89dc-b4320b182584 req-8fbb0a9b-4a2e-4fc0-9c41-8e931058c4c8 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0518200 Nov 11 17:20:13.720885 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-46eb9063-d085-4d9e-89dc-b4320b182584 req-da52c81d-9939-458e-b527-1874f881ea9d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401721 Nov 11 17:20:14.756514 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 82611dc2-0b34-439a-ab93-c3b0445d2747 details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:20:14.847621 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbb008f6-8e66-42ef-aa76-604580270682 req-4c231f8b-6b5d-4791-bd01-4e78c51e150c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:14.849165 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-cbb008f6-8e66-42ef-aa76-604580270682 req-4c231f8b-6b5d-4791-bd01-4e78c51e150c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0547144 Nov 11 17:20:14.854862 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 82611dc2-0b34-439a-ab93-c3b0445d2747, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=82611dc2-0b34-439a-ab93-c3b0445d2747,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:20:14.870231 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '82611dc2-0b34-439a-ab93-c3b0445d2747', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'port_id': '82611dc2-0b34-439a-ab93-c3b0445d2747', 'mac_address': 'fa:16:3e:34:67:78', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 538, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:20:14.902746 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac796ae6-4220-4156-8146-8525e5d6dd2e req-0f5561a6-2ac5-48c6-b09f-e71a31756f7d service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0429335 Nov 11 17:20:14.903414 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-cbb008f6-8e66-42ef-aa76-604580270682 req-3120d1c0-e3aa-4322-a396-5827520c8305 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476663 Nov 11 17:20:14.911332 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:14.924417 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 82611dc2-0b34-439a-ab93-c3b0445d2747 {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:20:14.944868 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 82611dc2-0b34-439a-ab93-c3b0445d2747, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=82611dc2-0b34-439a-ab93-c3b0445d2747,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:20:14.997798 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac796ae6-4220-4156-8146-8525e5d6dd2e req-039939e4-66bc-4b8e-a796-1a92ac986bc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:14.999316 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac796ae6-4220-4156-8146-8525e5d6dd2e req-039939e4-66bc-4b8e-a796-1a92ac986bc3 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=7e951c2eae284261a98b317ec84140db&device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 1098 time: 0.0465362 Nov 11 17:20:15.052496 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:15.115684 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=82611dc2-0b34-439a-ab93-c3b0445d2747,revision_number=6']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:20:15.116706 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac796ae6-4220-4156-8146-8525e5d6dd2e req-6c31b4b5-9d1c-4ac3-80fa-b65732605ea6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:15.118175 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac796ae6-4220-4156-8146-8525e5d6dd2e req-6c31b4b5-9d1c-4ac3-80fa-b65732605ea6 service neutron] 10.222.0.10 "GET /v2.0/networks?id=10ac93d3-f14d-4df5-a044-d683e35c1ab8 HTTP/1.1" status: 200 len: 912 time: 0.0958951 Nov 11 17:20:15.140049 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['82611dc2-0b34-439a-ab93-c3b0445d2747'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:20:15.195375 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac796ae6-4220-4156-8146-8525e5d6dd2e req-dfbeddcb-75ee-460f-a6b0-51c7c238d21a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 HTTP/1.1" status: 200 len: 1001 time: 0.0695519 Nov 11 17:20:15.255568 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac796ae6-4220-4156-8146-8525e5d6dd2e req-dc347245-8141-4ba2-b699-3eeeba00f441 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:15.257144 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac796ae6-4220-4156-8146-8525e5d6dd2e req-dc347245-8141-4ba2-b699-3eeeba00f441 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba HTTP/1.1" status: 200 len: 850 time: 0.0538900 Nov 11 17:20:15.305746 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac796ae6-4220-4156-8146-8525e5d6dd2e req-9849545f-4335-4696-9f1f-a8ce2c85a3b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:15.307197 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac796ae6-4220-4156-8146-8525e5d6dd2e req-9849545f-4335-4696-9f1f-a8ce2c85a3b2 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=10ac93d3-f14d-4df5-a044-d683e35c1ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0429866 Nov 11 17:20:15.413231 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac796ae6-4220-4156-8146-8525e5d6dd2e req-81cc2101-cd79-43d8-a385-1d88e4731b2c service neutron] 10.222.0.10 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0918770 Nov 11 17:20:15.504025 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac796ae6-4220-4156-8146-8525e5d6dd2e req-0b080829-8a7e-4c2b-8739-220116fd7f62 service neutron] 10.222.0.10 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835738 Nov 11 17:20:16.067741 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dfc2f0d-ba8a-4244-a612-ae27f266aaeb req-7613516e-fd3b-412e-887e-abf24383aed5 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:16.069578 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0dfc2f0d-ba8a-4244-a612-ae27f266aaeb req-7613516e-fd3b-412e-887e-abf24383aed5 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 945 time: 0.0730350 Nov 11 17:20:16.130159 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0dfc2f0d-ba8a-4244-a612-ae27f266aaeb req-09696e72-a1f3-4584-ba5c-ebcd879c491d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0542219 Nov 11 17:20:16.757205 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 82611dc2-0b34-439a-ab93-c3b0445d2747 up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:20:16.844102 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 82611dc2-0b34-439a-ab93-c3b0445d2747 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:20:16.844824 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:16.875136 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:16.955463 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:16.984065 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '82611dc2-0b34-439a-ab93-c3b0445d2747'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:20:16.986565 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-61a8ef76-711e-42ad-98fd-7f40abe6bed0" -d '{"events": [{"server_uuid": "db6c7ef4-59ed-41b0-9bd7-c576ebecf33e", "name": "network-vif-plugged", "status": "completed", "tag": "82611dc2-0b34-439a-ab93-c3b0445d2747"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:20:17.003860 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 82611dc2-0b34-439a-ab93-c3b0445d2747, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=82611dc2-0b34-439a-ab93-c3b0445d2747,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:20:17.032500 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:20:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-253724e0-d08a-416d-8a5b-15c4cb9ed985 x-openstack-request-id: req-253724e0-d08a-416d-8a5b-15c4cb9ed985 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:20:17.032998 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "db6c7ef4-59ed-41b0-9bd7-c576ebecf33e", "name": "network-vif-plugged", "status": "completed", "tag": "82611dc2-0b34-439a-ab93-c3b0445d2747", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:20:17.033445 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-253724e0-d08a-416d-8a5b-15c4cb9ed985 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:20:17.033972 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '82611dc2-0b34-439a-ab93-c3b0445d2747', 'code': 200} Nov 11 17:20:17.074512 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:17.134576 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=82611dc2-0b34-439a-ab93-c3b0445d2747,revision_number=7']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:20:17.262836 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38c32f6b-23e7-45df-9d4d-86c487703cee req-f4269457-3177-4d89-a2ba-d58c002e5561 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:17.264519 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-38c32f6b-23e7-45df-9d4d-86c487703cee req-f4269457-3177-4d89-a2ba-d58c002e5561 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0529919 Nov 11 17:20:17.326585 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-38c32f6b-23e7-45df-9d4d-86c487703cee req-86cc39dc-4e1c-4976-8808-811228895237 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0558920 Nov 11 17:20:18.461420 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38244b7e-c3b9-411b-b70d-ee06294e4c20 req-c0a09272-00f6-45fc-91af-dc7b002dc7c4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:18.463194 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-38244b7e-c3b9-411b-b70d-ee06294e4c20 req-c0a09272-00f6-45fc-91af-dc7b002dc7c4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0514123 Nov 11 17:20:18.517709 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-38244b7e-c3b9-411b-b70d-ee06294e4c20 req-7998314c-f1dc-47f8-9996-8e908fbb9cd9 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0481997 Nov 11 17:20:19.655112 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64a989fe-275f-453e-8ab8-0de029e5ee0f req-cb86a006-4cda-4c7a-b238-4998bca6f55c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:19.657068 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-64a989fe-275f-453e-8ab8-0de029e5ee0f req-cb86a006-4cda-4c7a-b238-4998bca6f55c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0581169 Nov 11 17:20:19.712929 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-64a989fe-275f-453e-8ab8-0de029e5ee0f req-01164e78-26a4-4e76-ba47-b6e141651702 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0493340 Nov 11 17:20:20.839557 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02483721-01bd-4556-ad33-d160fdb1c636 req-0a43a867-a696-49d0-b1ee-926a521e9fbe tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:20.843000 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-02483721-01bd-4556-ad33-d160fdb1c636 req-0a43a867-a696-49d0-b1ee-926a521e9fbe tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0531487 Nov 11 17:20:20.898060 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-02483721-01bd-4556-ad33-d160fdb1c636 req-119b51dc-20ae-4abe-a77a-5ba1edd1e4ea tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0504105 Nov 11 17:20:22.039072 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4df210db-1199-4be7-b580-0a7610255e0d req-b1d28863-6485-4c77-9096-970e431b40cc tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:22.040608 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4df210db-1199-4be7-b580-0a7610255e0d req-b1d28863-6485-4c77-9096-970e431b40cc tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0566893 Nov 11 17:20:22.092199 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4df210db-1199-4be7-b580-0a7610255e0d req-b9c77e90-0e9b-4f24-ba9c-30c5215ec05d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454938 Nov 11 17:20:23.234323 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b990ea8-0535-4c90-824b-f265ccd65cf3 req-482d1fd4-19e5-412e-9da0-d833650b2c07 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:23.236829 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4b990ea8-0535-4c90-824b-f265ccd65cf3 req-482d1fd4-19e5-412e-9da0-d833650b2c07 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0621619 Nov 11 17:20:23.292612 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4b990ea8-0535-4c90-824b-f265ccd65cf3 req-51f0c35a-3055-4555-b389-7d41679127c5 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0488808 Nov 11 17:20:23.957356 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-441997e0-8c45-4a5f-bb14-a5cb5f6917fb req-662ead49-eec0-410d-a9c4-cd22ec101b31 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:23.959172 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-441997e0-8c45-4a5f-bb14-a5cb5f6917fb req-662ead49-eec0-410d-a9c4-cd22ec101b31 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0644608 Nov 11 17:20:24.027960 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-441997e0-8c45-4a5f-bb14-a5cb5f6917fb req-aab2f626-2eb1-4576-9958-b83f2af36cca tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0543921 Nov 11 17:20:24.434059 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f4481de-347e-4ccb-a57e-0b34a9307831 req-8fbd242c-d572-45af-8076-c84ee3869e07 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:24.436678 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7f4481de-347e-4ccb-a57e-0b34a9307831 req-8fbd242c-d572-45af-8076-c84ee3869e07 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0618389 Nov 11 17:20:24.497728 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7f4481de-347e-4ccb-a57e-0b34a9307831 req-df0f4254-9459-4dc8-ba89-67d98be06670 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0533237 Nov 11 17:20:25.172844 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8f5a669-6ed3-4de3-ba58-e8321cba6781 req-dfd7d6c2-6024-42fd-a039-6b70164e1fa4 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:25.174327 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a8f5a669-6ed3-4de3-ba58-e8321cba6781 req-dfd7d6c2-6024-42fd-a039-6b70164e1fa4 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0535076 Nov 11 17:20:25.227195 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a8f5a669-6ed3-4de3-ba58-e8321cba6781 req-7e41df84-1616-4d8e-9f3e-fdf57de4f46b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456135 Nov 11 17:20:25.650646 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-782e4164-74e4-4e49-acb6-3db3c9ecccfb req-6562825f-bc4d-413f-90f5-30abcd2b892a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:25.652121 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-782e4164-74e4-4e49-acb6-3db3c9ecccfb req-6562825f-bc4d-413f-90f5-30abcd2b892a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0640733 Nov 11 17:20:25.707870 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-782e4164-74e4-4e49-acb6-3db3c9ecccfb req-0223c269-3993-45d1-a961-10e224175520 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0486166 Nov 11 17:20:26.342838 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34fcc025-2935-4669-abe7-727fcd6d27d1 req-aa3dd36d-3668-4a92-8054-8dea25ce6a76 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:26.344612 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-34fcc025-2935-4669-abe7-727fcd6d27d1 req-aa3dd36d-3668-4a92-8054-8dea25ce6a76 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0487211 Nov 11 17:20:26.401603 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-34fcc025-2935-4669-abe7-727fcd6d27d1 req-0501d511-f40f-4db3-b107-c03c7d299511 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0500605 Nov 11 17:20:26.831517 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63d5c2b1-81a2-4c4c-a6eb-78680be3510e req-a92155d6-da96-4585-88ab-469eaf9ffccb tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:26.833017 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-63d5c2b1-81a2-4c4c-a6eb-78680be3510e req-a92155d6-da96-4585-88ab-469eaf9ffccb tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0517914 Nov 11 17:20:26.881091 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-63d5c2b1-81a2-4c4c-a6eb-78680be3510e req-7b58fe13-dda0-45f1-ae20-b6b33d44776b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421691 Nov 11 17:20:27.276037 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34c9133-f99c-44ab-8745-73c58a7e4fcf req-60f8d4e3-b543-4d9f-a57e-3bb224ed2029 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:27.277591 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e34c9133-f99c-44ab-8745-73c58a7e4fcf req-60f8d4e3-b543-4d9f-a57e-3bb224ed2029 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=3a6e5bdc578b460ab28a883efa598f95&device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 1099 time: 0.0414765 Nov 11 17:20:27.375016 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34c9133-f99c-44ab-8745-73c58a7e4fcf req-42aabe38-b50c-447d-817b-fee6559e4e9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:27.376492 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e34c9133-f99c-44ab-8745-73c58a7e4fcf req-42aabe38-b50c-447d-817b-fee6559e4e9e service neutron] 10.222.0.10 "GET /v2.0/networks?id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f HTTP/1.1" status: 200 len: 917 time: 0.0892861 Nov 11 17:20:27.443452 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e34c9133-f99c-44ab-8745-73c58a7e4fcf req-34371f09-914c-4e54-90b7-1d42115107eb service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=82611dc2-0b34-439a-ab93-c3b0445d2747 HTTP/1.1" status: 200 len: 1001 time: 0.0589919 Nov 11 17:20:27.496175 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34c9133-f99c-44ab-8745-73c58a7e4fcf req-cb54d716-f52c-4a38-99e2-0bc85b554648 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:27.497623 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e34c9133-f99c-44ab-8745-73c58a7e4fcf req-cb54d716-f52c-4a38-99e2-0bc85b554648 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=1a4b11d7-2160-49c3-be78-265f0700c580 HTTP/1.1" status: 200 len: 855 time: 0.0452163 Nov 11 17:20:27.519700 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67b8bc29-ae5e-43a1-bf3a-a8037baa9ef5 req-daf5e63a-38fd-496d-89ef-7e3e6cee24d3 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:27.521350 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-67b8bc29-ae5e-43a1-bf3a-a8037baa9ef5 req-daf5e63a-38fd-496d-89ef-7e3e6cee24d3 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0515571 Nov 11 17:20:27.554346 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34c9133-f99c-44ab-8745-73c58a7e4fcf req-260f1fed-7115-4749-a8fa-1fcca408cd3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:27.555862 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e34c9133-f99c-44ab-8745-73c58a7e4fcf req-260f1fed-7115-4749-a8fa-1fcca408cd3e service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0457911 Nov 11 17:20:27.571583 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-67b8bc29-ae5e-43a1-bf3a-a8037baa9ef5 req-da8aa680-7d3b-4ec0-a53a-2402bf889c3a tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438530 Nov 11 17:20:27.651266 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e34c9133-f99c-44ab-8745-73c58a7e4fcf req-e374efa6-417e-4727-8fe6-85c38c724121 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0825648 Nov 11 17:20:27.750108 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e34c9133-f99c-44ab-8745-73c58a7e4fcf req-19b55a94-f07a-40ca-a664-7a474d0214be service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868320 Nov 11 17:20:28.002318 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee9f44c8-e4cc-4b3d-849b-70fb570ec3e8 req-4f20c5ac-3673-4519-94cd-60844f8c2150 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:28.003904 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ee9f44c8-e4cc-4b3d-849b-70fb570ec3e8 req-4f20c5ac-3673-4519-94cd-60844f8c2150 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0518947 Nov 11 17:20:28.052715 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ee9f44c8-e4cc-4b3d-849b-70fb570ec3e8 req-753f8200-c9ce-464d-94a4-eedd2f7fd6ae tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428333 Nov 11 17:20:28.692622 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f55e07ca-e966-4436-8b9c-46b469bf0706 req-3fb18d94-35c3-44ad-b657-d98bfa304348 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:28.694194 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f55e07ca-e966-4436-8b9c-46b469bf0706 req-3fb18d94-35c3-44ad-b657-d98bfa304348 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0512459 Nov 11 17:20:28.745466 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f55e07ca-e966-4436-8b9c-46b469bf0706 req-300b4dd4-236c-40ac-89a7-ec9fe1a64dda tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451951 Nov 11 17:20:29.177880 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e50039c-5493-44ce-9689-001e9760e140 req-491c5c7a-1397-4775-8d6d-ce1d40932c14 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:29.179436 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1e50039c-5493-44ce-9689-001e9760e140 req-491c5c7a-1397-4775-8d6d-ce1d40932c14 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0515225 Nov 11 17:20:29.236347 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1e50039c-5493-44ce-9689-001e9760e140 req-1cbfd0cd-2d3b-4ea5-add0-8143501e4c78 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0494621 Nov 11 17:20:29.869172 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe6631e4-cab4-4009-9a7c-940fd3d6b38d req-e2ecb31e-cca6-46bc-bbca-884eb56b22fa tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:29.870789 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fe6631e4-cab4-4009-9a7c-940fd3d6b38d req-e2ecb31e-cca6-46bc-bbca-884eb56b22fa tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0559080 Nov 11 17:20:29.928118 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fe6631e4-cab4-4009-9a7c-940fd3d6b38d req-7bac5701-11d4-4cae-85ff-d32679b93d8a tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465283 Nov 11 17:20:30.369136 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a611a5d1-c37a-4a7d-a894-a68f84c91b63 req-47f23c9d-9cb3-42be-a526-e9e0720f3cd3 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:30.370731 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a611a5d1-c37a-4a7d-a894-a68f84c91b63 req-47f23c9d-9cb3-42be-a526-e9e0720f3cd3 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 946 time: 0.0519795 Nov 11 17:20:30.424952 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a611a5d1-c37a-4a7d-a894-a68f84c91b63 req-30a108ad-878c-4511-b5da-19c477549c00 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478368 Nov 11 17:20:30.850928 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 82611dc2-0b34-439a-ab93-c3b0445d2747 no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:20:30.946152 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:30.970811 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '82611dc2-0b34-439a-ab93-c3b0445d2747'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:20:30.973752 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-857b26fd-67f2-4f6c-b874-0c3eb148b58f" -d '{"events": [{"server_uuid": "db6c7ef4-59ed-41b0-9bd7-c576ebecf33e", "name": "network-vif-unplugged", "status": "completed", "tag": "82611dc2-0b34-439a-ab93-c3b0445d2747"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:20:30.987671 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 82611dc2-0b34-439a-ab93-c3b0445d2747, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=82611dc2-0b34-439a-ab93-c3b0445d2747,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:20:30.989035 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-7e5dc594-c1e7-4da2-abbd-1ec98ea0d3d3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:31.056840 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d11b861-6a32-4163-900b-2edba23c9e79 req-6a6a4b13-1887-4191-8846-6879cdfc4077 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:31.058341 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9d11b861-6a32-4163-900b-2edba23c9e79 req-6a6a4b13-1887-4191-8846-6879cdfc4077 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0499361 Nov 11 17:20:31.068655 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:31.126675 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=82611dc2-0b34-439a-ab93-c3b0445d2747,revision_number=8']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:20:31.128460 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9d11b861-6a32-4163-900b-2edba23c9e79 req-32a42bae-b5b4-4abc-a159-6fcaa83c1b88 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0618489 Nov 11 17:20:31.177294 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Thu, 11 Nov 2021 17:20:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4d1d7be3-7c53-4b13-a4d4-bb4736ece09d x-openstack-request-id: req-4d1d7be3-7c53-4b13-a4d4-bb4736ece09d {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:20:31.177642 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "db6c7ef4-59ed-41b0-9bd7-c576ebecf33e", "name": "network-vif-unplugged", "status": "failed", "tag": "82611dc2-0b34-439a-ab93-c3b0445d2747", "code": 422}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:20:31.177969 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-4d1d7be3-7c53-4b13-a4d4-bb4736ece09d {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:20:31.178408 dv-cinder-694140-2-iscsi neutron-server[102325]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '82611dc2-0b34-439a-ab93-c3b0445d2747', 'code': 422} returned with failed status Nov 11 17:20:32.272583 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393033b0-4ab5-4361-ba4f-e70f99f227a4 req-9dcf592b-161a-4257-8b21-6b05c2747bb0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:32.274112 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-393033b0-4ab5-4361-ba4f-e70f99f227a4 req-9dcf592b-161a-4257-8b21-6b05c2747bb0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0643477 Nov 11 17:20:32.329994 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-393033b0-4ab5-4361-ba4f-e70f99f227a4 req-da920f05-056b-4147-a078-660bb80a52f0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469966 Nov 11 17:20:32.632437 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d7939b0-5942-4d51-84bb-4e11eabba098 req-85abf3bd-8cdb-4f3a-aece-9bfccb912d34 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:32.634101 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6d7939b0-5942-4d51-84bb-4e11eabba098 req-85abf3bd-8cdb-4f3a-aece-9bfccb912d34 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0530922 Nov 11 17:20:32.684517 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6d7939b0-5942-4d51-84bb-4e11eabba098 req-c643e960-745b-4907-8ad3-c658e8f529ac tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443044 Nov 11 17:20:32.861509 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-cdf4a086-4c63-40f1-af92-57f51ee63bc7 req-b9f2abf0-3927-45e9-93f8-5bf20a5792ad service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0391955 Nov 11 17:20:33.452500 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1895dc8-fca5-4c8a-ab30-9be80d862bae req-6d8b00d5-6b74-475f-8a07-5621432ff16d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:33.453976 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e1895dc8-fca5-4c8a-ab30-9be80d862bae req-6d8b00d5-6b74-475f-8a07-5621432ff16d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0542617 Nov 11 17:20:33.502856 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ef048741-4959-4793-87a9-28cff9565dd7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:33.504908 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e1895dc8-fca5-4c8a-ab30-9be80d862bae req-d81a04e9-b123-4be5-a6d5-ccfa5f6b9b78 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432818 Nov 11 17:20:33.807123 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be707e62-affb-4560-937c-8d11f7b3a566 req-80365b1f-cc92-4b27-8639-1fa2efcd4e98 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:33.808628 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-be707e62-affb-4560-937c-8d11f7b3a566 req-80365b1f-cc92-4b27-8639-1fa2efcd4e98 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0489469 Nov 11 17:20:33.864610 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-be707e62-affb-4560-937c-8d11f7b3a566 req-2e757bc7-5f2e-44d1-a301-155c2f9cddad tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0500538 Nov 11 17:20:34.253409 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4a086-4c63-40f1-af92-57f51ee63bc7 req-640c3369-5aae-4d7f-9272-e9a261f8cc49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:34.254918 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cdf4a086-4c63-40f1-af92-57f51ee63bc7 req-640c3369-5aae-4d7f-9272-e9a261f8cc49 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e&tenant_id=3a6e5bdc578b460ab28a883efa598f95 HTTP/1.1" status: 200 len: 1097 time: 0.0697091 Nov 11 17:20:34.320675 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4a086-4c63-40f1-af92-57f51ee63bc7 req-9fbd01c2-c700-4bd9-b5b2-8ccb17aff777 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:34.322304 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cdf4a086-4c63-40f1-af92-57f51ee63bc7 req-9fbd01c2-c700-4bd9-b5b2-8ccb17aff777 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=3a6e5bdc578b460ab28a883efa598f95&device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 1097 time: 0.0449524 Nov 11 17:20:34.413781 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4a086-4c63-40f1-af92-57f51ee63bc7 req-03d433ec-0fbc-4028-8653-d6245e140245 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:34.415195 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cdf4a086-4c63-40f1-af92-57f51ee63bc7 req-03d433ec-0fbc-4028-8653-d6245e140245 service neutron] 10.222.0.10 "GET /v2.0/networks?id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f HTTP/1.1" status: 200 len: 917 time: 0.0853751 Nov 11 17:20:34.486369 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cdf4a086-4c63-40f1-af92-57f51ee63bc7 req-31be277d-9a1e-4e67-a533-6367b24311a1 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=82611dc2-0b34-439a-ab93-c3b0445d2747 HTTP/1.1" status: 200 len: 999 time: 0.0635281 Nov 11 17:20:34.537252 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4a086-4c63-40f1-af92-57f51ee63bc7 req-8433baac-18f3-46b8-b074-7cfdb1b727d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:34.538713 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cdf4a086-4c63-40f1-af92-57f51ee63bc7 req-8433baac-18f3-46b8-b074-7cfdb1b727d5 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=1a4b11d7-2160-49c3-be78-265f0700c580 HTTP/1.1" status: 200 len: 855 time: 0.0450401 Nov 11 17:20:34.593916 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:34.615491 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4a086-4c63-40f1-af92-57f51ee63bc7 req-9512c47a-675d-4579-b46a-d0dd8daab769 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:34.616978 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cdf4a086-4c63-40f1-af92-57f51ee63bc7 req-9512c47a-675d-4579-b46a-d0dd8daab769 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0701416 Nov 11 17:20:34.629257 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46d4883e-1155-4acc-9b17-2fa3c318fbeb req-1a3ea79d-c6df-4289-9469-bdc91d35442f tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:34.630710 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-46d4883e-1155-4acc-9b17-2fa3c318fbeb req-1a3ea79d-c6df-4289-9469-bdc91d35442f tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0573339 Nov 11 17:20:34.729622 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-46d4883e-1155-4acc-9b17-2fa3c318fbeb req-a4917342-932f-445e-9f86-8f88635ba646 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0909059 Nov 11 17:20:34.747609 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cdf4a086-4c63-40f1-af92-57f51ee63bc7 req-af4f7b68-d62b-48bd-8aa4-454a2b8283f8 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1159055 Nov 11 17:20:35.098084 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-763258c0-1b11-4eaa-8790-1b42adbff3c0 req-69713177-13fb-4a28-8fb5-4a9254687660 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:35.099970 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-763258c0-1b11-4eaa-8790-1b42adbff3c0 req-69713177-13fb-4a28-8fb5-4a9254687660 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0598745 Nov 11 17:20:35.131932 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cdf4a086-4c63-40f1-af92-57f51ee63bc7 req-a4101012-04b5-40e3-b555-bfe369e447ba service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3759701 Nov 11 17:20:35.139634 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34a66f00-a3c5-493c-b190-53e13362ee88 req-006503ad-8d09-4183-8476-d8e698ea530b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:35.141115 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-34a66f00-a3c5-493c-b190-53e13362ee88 req-006503ad-8d09-4183-8476-d8e698ea530b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0769918 Nov 11 17:20:35.161801 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-763258c0-1b11-4eaa-8790-1b42adbff3c0 req-1b0e448c-968c-4a86-b6b8-1d7ebff7779b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0516961 Nov 11 17:20:35.223654 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-34a66f00-a3c5-493c-b190-53e13362ee88 req-9f8c18cf-7ade-47a3-a659-5be9118854cd tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0740776 Nov 11 17:20:35.230243 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c50f3c73-76bd-4e07-a13f-ddf8df5fbf8b req-ef4782bf-f5e4-4f03-92f7-13168250da28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:35.231854 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c50f3c73-76bd-4e07-a13f-ddf8df5fbf8b req-ef4782bf-f5e4-4f03-92f7-13168250da28 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=7e951c2eae284261a98b317ec84140db&device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 1098 time: 0.0738902 Nov 11 17:20:35.327056 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c50f3c73-76bd-4e07-a13f-ddf8df5fbf8b req-d37b01eb-979e-4a6a-a949-98d459021ad1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:35.328500 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c50f3c73-76bd-4e07-a13f-ddf8df5fbf8b req-d37b01eb-979e-4a6a-a949-98d459021ad1 service neutron] 10.222.0.10 "GET /v2.0/networks?id=10ac93d3-f14d-4df5-a044-d683e35c1ab8 HTTP/1.1" status: 200 len: 912 time: 0.0837963 Nov 11 17:20:35.401831 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c50f3c73-76bd-4e07-a13f-ddf8df5fbf8b req-3fe81c70-c098-400f-b36f-2d92d1fac7cd service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 HTTP/1.1" status: 200 len: 1001 time: 0.0655787 Nov 11 17:20:35.452602 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c50f3c73-76bd-4e07-a13f-ddf8df5fbf8b req-34f45b56-ebab-4fc3-91d3-517b6105b84f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:35.454106 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c50f3c73-76bd-4e07-a13f-ddf8df5fbf8b req-34f45b56-ebab-4fc3-91d3-517b6105b84f service neutron] 10.222.0.10 "GET /v2.0/subnets?id=cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba HTTP/1.1" status: 200 len: 850 time: 0.0447781 Nov 11 17:20:35.503779 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c50f3c73-76bd-4e07-a13f-ddf8df5fbf8b req-95757a24-56c5-4c45-99d4-a9c0eda3d152 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:35.503779 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c50f3c73-76bd-4e07-a13f-ddf8df5fbf8b req-95757a24-56c5-4c45-99d4-a9c0eda3d152 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=10ac93d3-f14d-4df5-a044-d683e35c1ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0419433 Nov 11 17:20:35.618094 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c50f3c73-76bd-4e07-a13f-ddf8df5fbf8b req-ba5446bb-353d-445e-9666-a04406a09f00 service neutron] 10.222.0.10 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1022964 Nov 11 17:20:36.280579 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f122d421-4aed-4cf8-9d7d-bd2d4824649a req-afc8b995-3a83-44db-a5d9-b73e0a7b898c tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:36.282163 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f122d421-4aed-4cf8-9d7d-bd2d4824649a req-afc8b995-3a83-44db-a5d9-b73e0a7b898c tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0504739 Nov 11 17:20:36.336215 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f122d421-4aed-4cf8-9d7d-bd2d4824649a req-7cd1c3a1-a11a-4c0f-9651-0a1c180bd337 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462127 Nov 11 17:20:36.341881 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:36.362559 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bd28296-0a72-4075-9aca-08e1463a846e req-a514f03c-551e-42c8-aca6-fc6293b04044 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:36.364318 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3bd28296-0a72-4075-9aca-08e1463a846e req-a514f03c-551e-42c8-aca6-fc6293b04044 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0600805 Nov 11 17:20:36.419367 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3bd28296-0a72-4075-9aca-08e1463a846e req-fed1a52e-53d3-4511-8ba2-524626ce3496 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447929 Nov 11 17:20:37.004534 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:37.467500 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd554934-045d-471b-86b8-f7630261e59e req-ff8d810d-0846-4d50-9a24-fb5c58ce908d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:37.469226 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fd554934-045d-471b-86b8-f7630261e59e req-ff8d810d-0846-4d50-9a24-fb5c58ce908d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0561800 Nov 11 17:20:37.526662 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fd554934-045d-471b-86b8-f7630261e59e req-4196db36-f8c1-40dc-9de9-ef841379a2e3 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478210 Nov 11 17:20:37.545781 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d08e08a4-34c6-47e5-bd5b-8d989d8d5125 req-868392ff-0303-47c4-af63-4d5d0248d5e4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:37.555010 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d08e08a4-34c6-47e5-bd5b-8d989d8d5125 req-868392ff-0303-47c4-af63-4d5d0248d5e4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0634117 Nov 11 17:20:37.606772 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d08e08a4-34c6-47e5-bd5b-8d989d8d5125 req-689c78d2-2250-46d4-9c5d-1c4e2a607386 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0507410 Nov 11 17:20:38.657281 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f566225f-5396-4ff9-a7af-52272d11bd4c req-cccb6867-7aba-4aba-9b47-40000cc8c195 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:38.659676 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f566225f-5396-4ff9-a7af-52272d11bd4c req-cccb6867-7aba-4aba-9b47-40000cc8c195 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0641167 Nov 11 17:20:38.738627 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f566225f-5396-4ff9-a7af-52272d11bd4c req-9630afab-9000-4eb5-a5e0-fd81986ad2b3 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0720785 Nov 11 17:20:38.741757 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c55d528a-f5f0-4399-aef7-9315eef84b1c req-621a48b1-aaa1-4139-a7fd-648dd5cba751 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:38.743486 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c55d528a-f5f0-4399-aef7-9315eef84b1c req-621a48b1-aaa1-4139-a7fd-648dd5cba751 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0578926 Nov 11 17:20:38.793596 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c55d528a-f5f0-4399-aef7-9315eef84b1c req-2c53c2c7-873c-4bf4-bc4b-3c3ff0c081f6 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441010 Nov 11 17:20:39.878826 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b807521a-a20d-4b62-a42b-4f32db8f5a94 req-44ab5bb5-6fc4-490d-9655-7eeeb8a86cd7 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:39.880831 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b807521a-a20d-4b62-a42b-4f32db8f5a94 req-44ab5bb5-6fc4-490d-9655-7eeeb8a86cd7 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0551918 Nov 11 17:20:39.930713 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-811f39b6-b1a7-4d9e-8a84-94ecdc71703c req-a380e64e-f711-4353-a326-2d25da0668fd tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:39.932213 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-811f39b6-b1a7-4d9e-8a84-94ecdc71703c req-a380e64e-f711-4353-a326-2d25da0668fd tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0512903 Nov 11 17:20:39.934524 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b807521a-a20d-4b62-a42b-4f32db8f5a94 req-36696a31-a460-4c12-83c2-5ebb82957ec0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0472877 Nov 11 17:20:39.995494 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-811f39b6-b1a7-4d9e-8a84-94ecdc71703c req-cc07eeb9-35a6-4377-ab7f-52a35fca4cde tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0566895 Nov 11 17:20:41.066047 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19fe076d-8992-4422-a9f3-c9b2e6b368c4 req-7f064034-851b-4c8e-88c6-3253ff0425c7 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:41.067735 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-19fe076d-8992-4422-a9f3-c9b2e6b368c4 req-7f064034-851b-4c8e-88c6-3253ff0425c7 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0648189 Nov 11 17:20:41.134925 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-19fe076d-8992-4422-a9f3-c9b2e6b368c4 req-34b6c224-1d19-4410-a11f-f9a1e22abbfe tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0609257 Nov 11 17:20:41.147530 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-800979bf-59b5-4d6d-ab65-81babe00209f req-9a552d87-cc3d-44d2-b7d3-ad95faa2af55 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:41.151436 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-800979bf-59b5-4d6d-ab65-81babe00209f req-9a552d87-cc3d-44d2-b7d3-ad95faa2af55 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0713701 Nov 11 17:20:41.200222 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-800979bf-59b5-4d6d-ab65-81babe00209f req-8fe2b8e7-6011-405d-a455-2d0ec621adcc tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443659 Nov 11 17:20:42.271100 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bbe5efb-99fd-4f7c-94c8-aaf8ef9b47ff req-fc02bf35-0839-4157-95ce-8d3ef9db2c21 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:42.274067 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7bbe5efb-99fd-4f7c-94c8-aaf8ef9b47ff req-fc02bf35-0839-4157-95ce-8d3ef9db2c21 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0645862 Nov 11 17:20:42.328396 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7bbe5efb-99fd-4f7c-94c8-aaf8ef9b47ff req-a58603a5-c27f-4dae-82be-b5590c1b794c tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476422 Nov 11 17:20:42.347083 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d16b3d84-ffca-4848-add3-80afb28ae5d4 req-c6e45fef-0836-4c26-be92-55757466722d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:42.350280 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d16b3d84-ffca-4848-add3-80afb28ae5d4 req-c6e45fef-0836-4c26-be92-55757466722d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0666165 Nov 11 17:20:42.403796 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d16b3d84-ffca-4848-add3-80afb28ae5d4 req-6dff2be6-701d-414b-92a7-8126de6518ef tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0487232 Nov 11 17:20:43.457434 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-419b027a-6c8e-408e-9fcb-6003b9da5bbe req-48836f56-a078-423f-b39d-b2e615188152 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:43.458963 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-419b027a-6c8e-408e-9fcb-6003b9da5bbe req-48836f56-a078-423f-b39d-b2e615188152 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0586257 Nov 11 17:20:43.512920 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-419b027a-6c8e-408e-9fcb-6003b9da5bbe req-f76eff43-eddb-4a19-9e9b-18d17765c0f2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0479107 Nov 11 17:20:43.533215 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b8f336-a4de-4278-8e0e-7ea7c17054ea req-906ea2e7-260c-437f-9542-4d0e629a6db2 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:43.534726 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a8b8f336-a4de-4278-8e0e-7ea7c17054ea req-906ea2e7-260c-437f-9542-4d0e629a6db2 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0523219 Nov 11 17:20:43.604162 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a8b8f336-a4de-4278-8e0e-7ea7c17054ea req-4fca0abd-649f-44b1-811b-ed2b119665ab tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0551274 Nov 11 17:20:44.651323 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b6061d2-4b04-4018-bce6-05710c3ddea4 req-0e9aa7ec-9d38-42f8-ac74-953dddb0b37f tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:44.652875 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6b6061d2-4b04-4018-bce6-05710c3ddea4 req-0e9aa7ec-9d38-42f8-ac74-953dddb0b37f tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0710766 Nov 11 17:20:44.725574 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6b6061d2-4b04-4018-bce6-05710c3ddea4 req-68c62f05-c9aa-4b44-8056-5ea4bda200c8 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0635006 Nov 11 17:20:44.741516 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d210229-892a-481c-bb31-7dab145f4cca req-53cb5911-817d-407f-8f5c-3044afd6758e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:44.743067 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7d210229-892a-481c-bb31-7dab145f4cca req-53cb5911-817d-407f-8f5c-3044afd6758e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0698678 Nov 11 17:20:44.807390 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7d210229-892a-481c-bb31-7dab145f4cca req-2995cd2a-4f30-4b2d-ae22-8ab54bd3d410 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0582824 Nov 11 17:20:45.840380 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4454963-4507-4bb2-9ca1-8a2a541814c7 req-9be170b9-bc5b-478b-a0e3-e0e52c51e945 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:45.848510 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a4454963-4507-4bb2-9ca1-8a2a541814c7 req-9be170b9-bc5b-478b-a0e3-e0e52c51e945 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0602090 Nov 11 17:20:45.900480 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a4454963-4507-4bb2-9ca1-8a2a541814c7 req-66deac84-6794-4f31-8906-b119c53f2b2d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0497210 Nov 11 17:20:45.944936 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c958b9fc-73a5-4212-839f-4b91322313b7 req-b311c45e-1364-4b91-9029-670d80379c95 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:45.946587 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c958b9fc-73a5-4212-839f-4b91322313b7 req-b311c45e-1364-4b91-9029-670d80379c95 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0581725 Nov 11 17:20:46.001143 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c958b9fc-73a5-4212-839f-4b91322313b7 req-4e0dcf85-21a5-44e5-8f53-be3c5ee9d809 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442009 Nov 11 17:20:46.879062 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:47.045573 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8ad970c-6813-41e8-b436-08ef07d0eb7c req-65b3866f-744f-4cd7-bb86-a804cd032bb6 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:47.047289 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a8ad970c-6813-41e8-b436-08ef07d0eb7c req-65b3866f-744f-4cd7-bb86-a804cd032bb6 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0555928 Nov 11 17:20:47.098726 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a8ad970c-6813-41e8-b436-08ef07d0eb7c req-1ecd3e21-f63d-4628-be46-6651ca1b10f4 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448394 Nov 11 17:20:47.130947 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5762483-7857-40cb-bc27-34dd1cd67978 req-1d9340df-de55-4cf7-a19e-86b58874c4c5 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:47.132321 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b5762483-7857-40cb-bc27-34dd1cd67978 req-1d9340df-de55-4cf7-a19e-86b58874c4c5 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0529332 Nov 11 17:20:47.179253 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b5762483-7857-40cb-bc27-34dd1cd67978 req-4e76fa05-2801-4584-b160-7d26c747e8ef tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408628 Nov 11 17:20:47.395906 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c50f3c73-76bd-4e07-a13f-ddf8df5fbf8b req-b58505a5-57ba-4a5c-ac9c-7fd57bdc1343 service neutron] 10.222.0.10 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0853252 Nov 11 17:20:48.214134 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-118f0cf8-4d0f-445f-a416-26f0cd0511f5 req-c2402808-ed3d-477b-89c6-57e81a9fc348 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:48.215682 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-118f0cf8-4d0f-445f-a416-26f0cd0511f5 req-c2402808-ed3d-477b-89c6-57e81a9fc348 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0497711 Nov 11 17:20:48.264097 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-118f0cf8-4d0f-445f-a416-26f0cd0511f5 req-305c53cd-7efc-4beb-9f7e-6fd202df075c tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421567 Nov 11 17:20:48.302803 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8228c9dc-08bd-477d-a471-69d7833b1134 req-40a3a670-d51c-45a7-93a0-6a0fc0177e9c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:48.304273 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8228c9dc-08bd-477d-a471-69d7833b1134 req-40a3a670-d51c-45a7-93a0-6a0fc0177e9c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 944 time: 0.0540531 Nov 11 17:20:48.352333 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8228c9dc-08bd-477d-a471-69d7833b1134 req-13e9ae60-40b6-466f-a1ff-74ba3d9f6b00 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421402 Nov 11 17:20:48.935405 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 82611dc2-0b34-439a-ab93-c3b0445d2747 details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:20:49.034787 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 82611dc2-0b34-439a-ab93-c3b0445d2747, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=82611dc2-0b34-439a-ab93-c3b0445d2747,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:20:49.045917 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '82611dc2-0b34-439a-ab93-c3b0445d2747', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'port_id': '82611dc2-0b34-439a-ab93-c3b0445d2747', 'mac_address': 'fa:16:3e:34:67:78', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 538, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:20:49.083335 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:49.097059 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 82611dc2-0b34-439a-ab93-c3b0445d2747 {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:20:49.116648 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 82611dc2-0b34-439a-ab93-c3b0445d2747, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=82611dc2-0b34-439a-ab93-c3b0445d2747,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:20:49.134814 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:20:49.182000 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:49.233721 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=82611dc2-0b34-439a-ab93-c3b0445d2747,revision_number=9']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:20:49.411996 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['82611dc2-0b34-439a-ab93-c3b0445d2747'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:20:49.476058 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6b19d4e-2fd3-400a-958c-b1dc13f15b29 req-178efa28-17e4-4161-a764-301a93e291a3 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:49.477527 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f6b19d4e-2fd3-400a-958c-b1dc13f15b29 req-178efa28-17e4-4161-a764-301a93e291a3 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 945 time: 0.0530286 Nov 11 17:20:49.526111 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f6b19d4e-2fd3-400a-958c-b1dc13f15b29 req-01626165-9437-4b25-acfe-d05fa61b0ec7 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426254 Nov 11 17:20:50.646304 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95fd7d81-4bc3-4da5-ae24-8edfb8e8ee15 req-97f39eb6-1cc4-4237-91e2-8b7333a4d13a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:50.647852 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-95fd7d81-4bc3-4da5-ae24-8edfb8e8ee15 req-97f39eb6-1cc4-4237-91e2-8b7333a4d13a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 945 time: 0.0488644 Nov 11 17:20:50.693968 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-95fd7d81-4bc3-4da5-ae24-8edfb8e8ee15 req-7844cc29-85a0-4c49-a4ea-094d825b442e tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401938 Nov 11 17:20:50.941641 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 82611dc2-0b34-439a-ab93-c3b0445d2747 up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:20:50.992668 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 82611dc2-0b34-439a-ab93-c3b0445d2747 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:20:50.993043 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:51.070183 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:51.092164 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '82611dc2-0b34-439a-ab93-c3b0445d2747'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:20:51.094646 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-53c3e91e-a70e-4976-a5a9-d8297977dfbf" -d '{"events": [{"server_uuid": "db6c7ef4-59ed-41b0-9bd7-c576ebecf33e", "name": "network-vif-plugged", "status": "completed", "tag": "82611dc2-0b34-439a-ab93-c3b0445d2747"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:20:51.107136 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 82611dc2-0b34-439a-ab93-c3b0445d2747, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=82611dc2-0b34-439a-ab93-c3b0445d2747,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:20:51.131117 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:20:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f3d3e319-2066-4044-9f97-fe3d27a49db7 x-openstack-request-id: req-f3d3e319-2066-4044-9f97-fe3d27a49db7 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:20:51.131403 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "db6c7ef4-59ed-41b0-9bd7-c576ebecf33e", "name": "network-vif-plugged", "status": "completed", "tag": "82611dc2-0b34-439a-ab93-c3b0445d2747", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:20:51.131648 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-f3d3e319-2066-4044-9f97-fe3d27a49db7 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:20:51.132031 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '82611dc2-0b34-439a-ab93-c3b0445d2747', 'code': 200} Nov 11 17:20:51.164584 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:20:51.218409 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=82611dc2-0b34-439a-ab93-c3b0445d2747,revision_number=10']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:20:51.432568 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46d388c5-85ba-4133-a2bf-0649528bb6f8 req-1ad1195c-74ad-4927-ba4d-28466294f565 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:51.434066 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-46d388c5-85ba-4133-a2bf-0649528bb6f8 req-1ad1195c-74ad-4927-ba4d-28466294f565 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 1100 time: 0.0433991 Nov 11 17:20:51.477465 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-46d388c5-85ba-4133-a2bf-0649528bb6f8 req-78048a9c-6221-4552-8dd9-be6293421c97 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0357199 Nov 11 17:20:51.814352 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9122bfc3-1e8e-467c-a5a0-2091e13299c4 req-99437ead-66f8-474b-a6d9-af07e6268138 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:51.816001 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9122bfc3-1e8e-467c-a5a0-2091e13299c4 req-99437ead-66f8-474b-a6d9-af07e6268138 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 947 time: 0.0500884 Nov 11 17:20:51.864362 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9122bfc3-1e8e-467c-a5a0-2091e13299c4 req-0ef64a58-b05f-45f4-820a-3b4fad28061b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424330 Nov 11 17:20:52.988341 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddb0d148-03d3-456a-8846-82fbfc221b66 req-e7e84a04-0c03-4153-9c3b-11b721a5806a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:52.989797 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ddb0d148-03d3-456a-8846-82fbfc221b66 req-e7e84a04-0c03-4153-9c3b-11b721a5806a tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 947 time: 0.0481977 Nov 11 17:20:53.039210 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ddb0d148-03d3-456a-8846-82fbfc221b66 req-a754ac6c-3552-4058-9978-3da9d70e145d tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435154 Nov 11 17:20:54.162731 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe3a22e-ca07-4700-afae-62dc9e06d99c req-fc8afdad-f595-42b0-a552-0b62cc7fead4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:20:54.164287 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bbe3a22e-ca07-4700-afae-62dc9e06d99c req-fc8afdad-f595-42b0-a552-0b62cc7fead4 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 947 time: 0.0500710 Nov 11 17:20:54.215304 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bbe3a22e-ca07-4700-afae-62dc9e06d99c req-4dba2752-eb94-4bcf-b90a-462dfa44ac40 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450816 Nov 11 17:21:00.958569 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c3f11a61-0a46-46bd-81ee-70cc36f4f275 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:03.494304 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-f01060a8-5bce-4fb5-87c2-0fa953c5684e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:04.580165 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:06.346204 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:06.991775 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:15.895407 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bdad0f02-4122-4f00-9a3d-0e8e41cc4158 req-f25ad4d0-e92e-4b8e-b167-d08897247662 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0399256 Nov 11 17:21:15.965178 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdad0f02-4122-4f00-9a3d-0e8e41cc4158 req-1e1665ef-26f0-4298-be37-8b62d9667caa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:15.976253 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bdad0f02-4122-4f00-9a3d-0e8e41cc4158 req-1e1665ef-26f0-4298-be37-8b62d9667caa service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=3a6e5bdc578b460ab28a883efa598f95&device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 1100 time: 0.0494144 Nov 11 17:21:16.081012 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdad0f02-4122-4f00-9a3d-0e8e41cc4158 req-003d7034-c11e-4e61-8b87-1e5ef4723dea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:16.083222 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bdad0f02-4122-4f00-9a3d-0e8e41cc4158 req-003d7034-c11e-4e61-8b87-1e5ef4723dea service neutron] 10.222.0.10 "GET /v2.0/networks?id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f HTTP/1.1" status: 200 len: 917 time: 0.0907371 Nov 11 17:21:16.150622 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bdad0f02-4122-4f00-9a3d-0e8e41cc4158 req-82f95d43-ea40-49f7-a9a4-2ecb203d1537 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=82611dc2-0b34-439a-ab93-c3b0445d2747 HTTP/1.1" status: 200 len: 1001 time: 0.0591276 Nov 11 17:21:16.200414 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdad0f02-4122-4f00-9a3d-0e8e41cc4158 req-737e538d-c370-41fd-a6c6-88e3e49ef6a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:16.201876 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bdad0f02-4122-4f00-9a3d-0e8e41cc4158 req-737e538d-c370-41fd-a6c6-88e3e49ef6a8 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=1a4b11d7-2160-49c3-be78-265f0700c580 HTTP/1.1" status: 200 len: 855 time: 0.0438907 Nov 11 17:21:16.254707 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdad0f02-4122-4f00-9a3d-0e8e41cc4158 req-6256ab97-463c-4556-b9b6-ee3895ebb8bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:16.256179 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bdad0f02-4122-4f00-9a3d-0e8e41cc4158 req-6256ab97-463c-4556-b9b6-ee3895ebb8bc service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0438900 Nov 11 17:21:16.349468 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bdad0f02-4122-4f00-9a3d-0e8e41cc4158 req-15345a6c-0f59-4743-8880-a25b77263217 service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847800 Nov 11 17:21:16.449868 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bdad0f02-4122-4f00-9a3d-0e8e41cc4158 req-70831485-ee18-4d53-bc53-d94171b6186a service neutron] 10.222.0.10 "GET /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0903294 Nov 11 17:21:16.877548 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:26.134006 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:21:27.123135 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03d62c47-9be0-44d2-aea3-a919fc251690 req-6d25b9a7-b9f0-4e55-98a7-f27fefda527f tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:27.124628 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-03d62c47-9be0-44d2-aea3-a919fc251690 req-6d25b9a7-b9f0-4e55-98a7-f27fefda527f tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0504947 Nov 11 17:21:27.186849 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-03d62c47-9be0-44d2-aea3-a919fc251690 req-fa063fcc-39a7-4685-9846-4614316d98da tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0555148 Nov 11 17:21:28.102805 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f9b47d6-4aae-4045-a6a7-d4bbc68ce909 req-df1e4c55-c0c1-4efb-97dd-1a4f4b3b4328 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:28.104295 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4f9b47d6-4aae-4045-a6a7-d4bbc68ce909 req-df1e4c55-c0c1-4efb-97dd-1a4f4b3b4328 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 947 time: 0.0498056 Nov 11 17:21:28.151305 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4f9b47d6-4aae-4045-a6a7-d4bbc68ce909 req-76d964b7-ecc5-46f8-831e-7b3b231aa04f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409651 Nov 11 17:21:28.304651 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6038e1e-9c2c-4b7b-a726-141785cf9842 req-ef15e9b5-6af3-41d0-9613-98b22a032dfa tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:28.306011 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a6038e1e-9c2c-4b7b-a726-141785cf9842 req-ef15e9b5-6af3-41d0-9613-98b22a032dfa tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0485647 Nov 11 17:21:28.354530 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a6038e1e-9c2c-4b7b-a726-141785cf9842 req-2e8348ae-8039-4e86-9005-c35bde2ce98b tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423484 Nov 11 17:21:29.179313 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7c6669f-9c02-433b-87f8-e6fd4c48b913 req-57144e39-262f-46a1-8730-70d86e1965dd tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:29.181007 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f7c6669f-9c02-433b-87f8-e6fd4c48b913 req-57144e39-262f-46a1-8730-70d86e1965dd tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.10 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0490656 Nov 11 17:21:29.309368 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-621a164c-b3cc-4b62-83d6-59f74b72f0a2 req-95840221-d90b-4e53-8eec-89c96c7774da tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:29.310866 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-621a164c-b3cc-4b62-83d6-59f74b72f0a2 req-95840221-d90b-4e53-8eec-89c96c7774da tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 947 time: 0.0814140 Nov 11 17:21:29.345736 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-f7c6669f-9c02-433b-87f8-e6fd4c48b913 req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Deleting port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:21:29.346076 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f7c6669f-9c02-433b-87f8-e6fd4c48b913 req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:29.420471 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-621a164c-b3cc-4b62-83d6-59f74b72f0a2 req-6c9f039b-7c98-47c2-a155-84304b64f9eb tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups?id=438d3606-b70e-495a-a217-7f77d339ec4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1022143 Nov 11 17:21:29.462804 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-f7c6669f-9c02-433b-87f8-e6fd4c48b913 req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] For port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:21:29.463163 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f7c6669f-9c02-433b-87f8-e6fd4c48b913 req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:29.518330 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd9c61e8-3a28-4d0d-a84f-eb5ad754064d req-c7179cea-0c89-4d93-af71-170050383069 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:29.519938 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-cd9c61e8-3a28-4d0d-a84f-eb5ad754064d req-c7179cea-0c89-4d93-af71-170050383069 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 945 time: 0.0925055 Nov 11 17:21:29.530693 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-583a8015-6937-4285-86ce-fed2297a3c92 req-9139af08-065f-4e64-b6d0-88da73fdec28 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:29.532101 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-583a8015-6937-4285-86ce-fed2297a3c92 req-9139af08-065f-4e64-b6d0-88da73fdec28 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.10 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 947 time: 0.0689983 Nov 11 17:21:29.625578 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-cd9c61e8-3a28-4d0d-a84f-eb5ad754064d req-e4b22de0-3ec3-4adb-8916-c8360650ea83 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=aa8139a3-d43c-45ef-8f8e-58dc577c8c93&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0925071 Nov 11 17:21:29.636648 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f7c6669f-9c02-433b-87f8-e6fd4c48b913 req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:29.637001 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f7c6669f-9c02-433b-87f8-e6fd4c48b913 req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:29.637311 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.l3_db [req-f7c6669f-9c02-433b-87f8-e6fd4c48b913 req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Floating IP 4fcfc590-ae2f-475e-a84e-e1ea081069bb disassociated. External IP: 172.27.1.227, port: ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8. Nov 11 17:21:29.637643 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-f7c6669f-9c02-433b-87f8-e6fd4c48b913 req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Calling delete_port for ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 owned by compute:nova {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:21:29.653667 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [req-583a8015-6937-4285-86ce-fed2297a3c92 req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Deleting port 82611dc2-0b34-439a-ab93-c3b0445d2747 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:21:29.653667 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-583a8015-6937-4285-86ce-fed2297a3c92 req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:29.745633 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-583a8015-6937-4285-86ce-fed2297a3c92 req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] For port 82611dc2-0b34-439a-ab93-c3b0445d2747, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=82611dc2-0b34-439a-ab93-c3b0445d2747,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:21:29.745904 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-583a8015-6937-4285-86ce-fed2297a3c92 req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:29.831129 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f7c6669f-9c02-433b-87f8-e6fd4c48b913 req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:29.861256 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event deleted for resources: {'Port': ['ID=ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:29.871303 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:29.871646 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:29.871986 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:29.872321 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:29.872649 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:29.872979 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:29.873307 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:29.873629 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:29.873941 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:29.874265 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:29.874605 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:29.874929 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:29.927126 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-583a8015-6937-4285-86ce-fed2297a3c92 req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:29.927499 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-583a8015-6937-4285-86ce-fed2297a3c92 req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:29.927816 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.l3_db [req-583a8015-6937-4285-86ce-fed2297a3c92 req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Floating IP 047e3c82-79fa-478c-86dc-decb34ef9559 disassociated. External IP: 172.27.1.64, port: 82611dc2-0b34-439a-ab93-c3b0445d2747. Nov 11 17:21:29.928151 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [req-583a8015-6937-4285-86ce-fed2297a3c92 req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Calling delete_port for 82611dc2-0b34-439a-ab93-c3b0445d2747 owned by compute:nova {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:21:29.988358 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [req-f7c6669f-9c02-433b-87f8-e6fd4c48b913 req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Router 98cb701e-467a-4425-90db-9dbc5f732760 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:21:30.098331 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-f7c6669f-9c02-433b-87f8-e6fd4c48b913 req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:21:30.110995 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-256f9418-d706-4ca7-94dd-f46fa56e9313 None None] Sync routers for ids ['98cb701e-467a-4425-90db-9dbc5f732760'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:21:30.122429 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-256f9418-d706-4ca7-94dd-f46fa56e9313 None None] Routers {'98cb701e-467a-4425-90db-9dbc5f732760'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:21:30.123230 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-256f9418-d706-4ca7-94dd-f46fa56e9313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:21:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['98cb701e-467a-4425-90db-9dbc5f732760'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:30.143263 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-f7c6669f-9c02-433b-87f8-e6fd4c48b913 req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] No DVR routers for this DVR port ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 on host hv-cinder-69414 {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:21:30.145888 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f7c6669f-9c02-433b-87f8-e6fd4c48b913 req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:30.149438 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f7c6669f-9c02-433b-87f8-e6fd4c48b913 req-ef580bd9-9986-4007-99a7-cd1073ebf541 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.10 "DELETE /v2.0/ports/ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 HTTP/1.1" status: 204 len: 173 time: 0.9576705 Nov 11 17:21:30.149911 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '59f9c130-2087-4e5f-ad8c-1411737fd8a6', 'name': 'network-vif-deleted', 'tag': 'ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:21:30.152344 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7e25a308-a143-4ece-a708-8f287054e122" -d '{"events": [{"server_uuid": "59f9c130-2087-4e5f-ad8c-1411737fd8a6", "name": "network-vif-deleted", "tag": "ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:21:30.216922 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:21:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-00a5f78d-c32a-459f-80fe-d0b454359fee x-openstack-request-id: req-00a5f78d-c32a-459f-80fe-d0b454359fee {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:21:30.217527 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "59f9c130-2087-4e5f-ad8c-1411737fd8a6", "name": "network-vif-deleted", "tag": "ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:21:30.217527 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-00a5f78d-c32a-459f-80fe-d0b454359fee {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:21:30.218057 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '59f9c130-2087-4e5f-ad8c-1411737fd8a6', 'name': 'network-vif-deleted', 'tag': 'ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8', 'status': 'completed', 'code': 200} Nov 11 17:21:30.239418 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-256f9418-d706-4ca7-94dd-f46fa56e9313 None None] Set router 98cb701e-467a-4425-90db-9dbc5f732760 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:21:30.379827 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-583a8015-6937-4285-86ce-fed2297a3c92 req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:30.408705 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event deleted for resources: {'Port': ['ID=82611dc2-0b34-439a-ab93-c3b0445d2747,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:30.419006 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:30.419360 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:30.419707 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:30.420076 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:30.420392 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:30.420730 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:30.421071 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:30.421602 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:30.421949 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:30.422278 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:30.422637 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:30.422971 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:30.451688 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-256f9418-d706-4ca7-94dd-f46fa56e9313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a', 'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'mac_address': 'fa:16:3e:04:45:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:18:01Z', 'updated_at': '2021-11-11T17:18:07Z', 'revision_number': 5, 'project_id': '7e951c2eae284261a98b317ec84140db', 'subnets': [{'id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:30.484066 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-256f9418-d706-4ca7-94dd-f46fa56e9313 None None] Checking router: 98cb701e-467a-4425-90db-9dbc5f732760 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:21:30.492605 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-256f9418-d706-4ca7-94dd-f46fa56e9313 None None] Routers {'98cb701e-467a-4425-90db-9dbc5f732760'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:21:30.493220 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-256f9418-d706-4ca7-94dd-f46fa56e9313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:21:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['98cb701e-467a-4425-90db-9dbc5f732760'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:30.544580 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [req-583a8015-6937-4285-86ce-fed2297a3c92 req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Router 1a70d97d-215a-45d3-ba2b-b538e79a3278 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:21:30.602800 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-256f9418-d706-4ca7-94dd-f46fa56e9313 None None] Set router 98cb701e-467a-4425-90db-9dbc5f732760 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:21:30.615879 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b84f7280-4bf1-4e41-a8c8-4138b1d412cd req-16b37733-dd14-44c8-a2d9-0611dd8af73b tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 210 time: 0.0578439 Nov 11 17:21:30.692677 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-583a8015-6937-4285-86ce-fed2297a3c92 req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:21:30.705959 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d10bb94d-5d93-4310-bf2d-5e375c967b19 None None] Sync routers for ids ['1a70d97d-215a-45d3-ba2b-b538e79a3278'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:21:30.720327 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d10bb94d-5d93-4310-bf2d-5e375c967b19 None None] Routers {'1a70d97d-215a-45d3-ba2b-b538e79a3278'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:21:30.720941 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-d10bb94d-5d93-4310-bf2d-5e375c967b19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:21:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1a70d97d-215a-45d3-ba2b-b538e79a3278'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:30.738236 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [req-583a8015-6937-4285-86ce-fed2297a3c92 req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] No DVR routers for this DVR port 82611dc2-0b34-439a-ab93-c3b0445d2747 on host hv-cinder-69414 {{(pid=102323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:21:30.742112 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-583a8015-6937-4285-86ce-fed2297a3c92 req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:30.745932 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-583a8015-6937-4285-86ce-fed2297a3c92 req-77143905-5843-4d7a-bb8a-0ab96bd02d94 tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.10 "DELETE /v2.0/ports/82611dc2-0b34-439a-ab93-c3b0445d2747 HTTP/1.1" status: 204 len: 173 time: 1.2070191 Nov 11 17:21:30.747028 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'name': 'network-vif-deleted', 'tag': '82611dc2-0b34-439a-ab93-c3b0445d2747'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:21:30.749325 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-998c9464-d6dc-4513-8ea7-2ff5cc3f55ae" -d '{"events": [{"server_uuid": "db6c7ef4-59ed-41b0-9bd7-c576ebecf33e", "name": "network-vif-deleted", "tag": "82611dc2-0b34-439a-ab93-c3b0445d2747"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:21:30.776675 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-524b5639-7639-44e1-8d20-5789c4f03bfe req-70bc5b54-2deb-4348-9892-3a1521e344fd tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=59f9c130-2087-4e5f-ad8c-1411737fd8a6 HTTP/1.1" status: 200 len: 210 time: 0.0401051 Nov 11 17:21:30.804261 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:21:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-764f17df-aa56-4796-af92-696e7a451ff0 x-openstack-request-id: req-764f17df-aa56-4796-af92-696e7a451ff0 {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:21:30.806358 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "db6c7ef4-59ed-41b0-9bd7-c576ebecf33e", "name": "network-vif-deleted", "tag": "82611dc2-0b34-439a-ab93-c3b0445d2747", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:21:30.806358 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-764f17df-aa56-4796-af92-696e7a451ff0 {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:21:30.806358 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'db6c7ef4-59ed-41b0-9bd7-c576ebecf33e', 'name': 'network-vif-deleted', 'tag': '82611dc2-0b34-439a-ab93-c3b0445d2747', 'status': 'completed', 'code': 200} Nov 11 17:21:30.864142 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-256f9418-d706-4ca7-94dd-f46fa56e9313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a', 'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'mac_address': 'fa:16:3e:04:45:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:18:01Z', 'updated_at': '2021-11-11T17:18:07Z', 'revision_number': 5, 'project_id': '7e951c2eae284261a98b317ec84140db', 'subnets': [{'id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:30.864981 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-d10bb94d-5d93-4310-bf2d-5e375c967b19 None None] Set router 1a70d97d-215a-45d3-ba2b-b538e79a3278 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:21:30.898652 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-256f9418-d706-4ca7-94dd-f46fa56e9313 None None] The sync data for ids ['98cb701e-467a-4425-90db-9dbc5f732760'] in dv-cinder-694140-2-iscsi is: [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a', 'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'mac_address': 'fa:16:3e:04:45:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:18:01Z', 'updated_at': '2021-11-11T17:18:07Z', 'revision_number': 5, 'project_id': '7e951c2eae284261a98b317ec84140db', 'subnets': [{'id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:21:30.990785 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-9026a498-e2b0-454a-807e-e9a4143bd639 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:31.095739 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-d10bb94d-5d93-4310-bf2d-5e375c967b19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'aa2fc75b-4ee8-4417-b781-eb1c551f1c43', 'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'mac_address': 'fa:16:3e:61:80:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:15Z', 'updated_at': '2021-11-11T17:14:22Z', 'revision_number': 5, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'subnets': [{'id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:31.129856 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d10bb94d-5d93-4310-bf2d-5e375c967b19 None None] Checking router: 1a70d97d-215a-45d3-ba2b-b538e79a3278 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:21:31.139337 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d10bb94d-5d93-4310-bf2d-5e375c967b19 None None] Routers {'1a70d97d-215a-45d3-ba2b-b538e79a3278'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:21:31.139953 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-d10bb94d-5d93-4310-bf2d-5e375c967b19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:21:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1a70d97d-215a-45d3-ba2b-b538e79a3278'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:31.176543 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-037c4222-5feb-4b95-86c0-ae2af2205a89 None None] New status for floating IP 4fcfc590-ae2f-475e-a84e-e1ea081069bb: DOWN {{(pid=102325) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:21:31.254811 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-d10bb94d-5d93-4310-bf2d-5e375c967b19 None None] Set router 1a70d97d-215a-45d3-ba2b-b538e79a3278 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:21:31.562537 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-d10bb94d-5d93-4310-bf2d-5e375c967b19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'aa2fc75b-4ee8-4417-b781-eb1c551f1c43', 'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'mac_address': 'fa:16:3e:61:80:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:15Z', 'updated_at': '2021-11-11T17:14:22Z', 'revision_number': 5, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'subnets': [{'id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:31.593866 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d10bb94d-5d93-4310-bf2d-5e375c967b19 None None] The sync data for ids ['1a70d97d-215a-45d3-ba2b-b538e79a3278'] in dv-cinder-694140-2-iscsi is: [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:14:17Z', 'revision_number': 4, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'aa2fc75b-4ee8-4417-b781-eb1c551f1c43', 'name': '', 'network_id': '4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'mac_address': 'fa:16:3e:61:80:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:15Z', 'updated_at': '2021-11-11T17:14:22Z', 'revision_number': 5, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'subnets': [{'id': '1a4b11d7-2160-49c3-be78-265f0700c580', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:21:31.744067 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dcecf540-f04d-43f7-838d-7ebcd97a609b req-380b2db8-7126-44ad-be43-8262b773c7eb tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/ports?device_id=db6c7ef4-59ed-41b0-9bd7-c576ebecf33e HTTP/1.1" status: 200 len: 210 time: 0.0311241 Nov 11 17:21:31.841995 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e8a3477-41d7-4b1f-8f4f-90747c98d711 None None] New status for floating IP 047e3c82-79fa-478c-86dc-decb34ef9559: DOWN {{(pid=102326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:21:31.919004 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 35216) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:31.977192 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d354d2e9-2287-4cc2-9a21-79f2d9e1f159 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:32.001912 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d354d2e9-2287-4cc2-9a21-79f2d9e1f159 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:32.156358 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d354d2e9-2287-4cc2-9a21-79f2d9e1f159 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:32.159018 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d354d2e9-2287-4cc2-9a21-79f2d9e1f159 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:32.160825 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-d354d2e9-2287-4cc2-9a21-79f2d9e1f159 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "DELETE /v2.0/security-groups/aa8139a3-d43c-45ef-8f8e-58dc577c8c93 HTTP/1.1" status: 204 len: 168 time: 0.2407382 Nov 11 17:21:32.163723 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 35218) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:32.170911 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d354d2e9-2287-4cc2-9a21-79f2d9e1f159 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa8139a3-d43c-45ef-8f8e-58dc577c8c93,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:32.177551 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.api.v2.resource [None req-15207e99-3a02-4491-8905-046f0d15b4b0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] show failed (client error): The resource could not be found. Nov 11 17:21:32.178654 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-15207e99-3a02-4491-8905-046f0d15b4b0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups/aa8139a3-d43c-45ef-8f8e-58dc577c8c93 HTTP/1.1" status: 404 len: 347 time: 0.0138195 Nov 11 17:21:32.181506 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 35220) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:32.306227 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-4936b486-f012-4eaa-a664-ae410beffeb2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Deleting port be4062ef-7812-4821-a5ed-07a1e37ac208 {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:21:32.306484 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-4936b486-f012-4eaa-a664-ae410beffeb2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:32.380159 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-4936b486-f012-4eaa-a664-ae410beffeb2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:32.380477 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-4936b486-f012-4eaa-a664-ae410beffeb2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:32.392578 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-4936b486-f012-4eaa-a664-ae410beffeb2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Calling delete_port for be4062ef-7812-4821-a5ed-07a1e37ac208 owned by network:floatingip {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:21:32.584828 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-4936b486-f012-4eaa-a664-ae410beffeb2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:32.615919 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4936b486-f012-4eaa-a664-ae410beffeb2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event deleted for resources: {'Port': ['ID=be4062ef-7812-4821-a5ed-07a1e37ac208,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:32.681634 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-4936b486-f012-4eaa-a664-ae410beffeb2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for floatingip, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:32.684296 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-4936b486-f012-4eaa-a664-ae410beffeb2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:32.687621 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-4936b486-f012-4eaa-a664-ae410beffeb2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "DELETE /v2.0/floatingips/4fcfc590-ae2f-475e-a84e-e1ea081069bb HTTP/1.1" status: 204 len: 168 time: 0.5030394 Nov 11 17:21:32.883774 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 35230) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:32.951615 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bac7f011-b245-4daa-92b7-8536cb07bb8f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:32.977298 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bac7f011-b245-4daa-92b7-8536cb07bb8f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.099320 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bac7f011-b245-4daa-92b7-8536cb07bb8f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.101937 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bac7f011-b245-4daa-92b7-8536cb07bb8f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.105609 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-bac7f011-b245-4daa-92b7-8536cb07bb8f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "DELETE /v2.0/security-groups/438d3606-b70e-495a-a217-7f77d339ec4f HTTP/1.1" status: 204 len: 168 time: 0.2183926 Nov 11 17:21:33.106691 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 35232) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:33.114881 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bac7f011-b245-4daa-92b7-8536cb07bb8f tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=438d3606-b70e-495a-a217-7f77d339ec4f,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:33.127335 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.api.v2.resource [None req-2cafb8bd-1aee-416d-81fb-49466ac6918c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] show failed (client error): The resource could not be found. Nov 11 17:21:33.127335 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-2cafb8bd-1aee-416d-81fb-49466ac6918c tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "GET /v2.0/security-groups/438d3606-b70e-495a-a217-7f77d339ec4f HTTP/1.1" status: 404 len: 347 time: 0.0145898 Nov 11 17:21:33.131590 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 35234) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:33.133331 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 35236) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:33.135908 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-f4411589-cd79-486e-9228-b8a903a2d85e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Request body: {'security_group': {'name': 'tempest-securitygroup--334016335', 'description': 'tempest-description--1563313650'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:21:33.236107 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:21:33.254383 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f4411589-cd79-486e-9228-b8a903a2d85e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.258227 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:21:33.258622 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device ae7fe17b-51cb-4ae4-a57a-bd7a517cbfb8 not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:21:33.259025 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 82611dc2-0b34-439a-ab93-c3b0445d2747 no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:21:33.270357 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-5612c57c-077a-4de2-8643-aa4159edb9db tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Deleting port b300149d-6b5d-4954-a7d9-daf56ede73a9 {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:21:33.270956 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5612c57c-077a-4de2-8643-aa4159edb9db tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.283153 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: 82611dc2-0b34-439a-ab93-c3b0445d2747 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:21:33.283498 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 82611dc2-0b34-439a-ab93-c3b0445d2747 not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:21:33.327945 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f4411589-cd79-486e-9228-b8a903a2d85e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.353687 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5612c57c-077a-4de2-8643-aa4159edb9db tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.354007 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5612c57c-077a-4de2-8643-aa4159edb9db tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.365524 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-5612c57c-077a-4de2-8643-aa4159edb9db tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Calling delete_port for b300149d-6b5d-4954-a7d9-daf56ede73a9 owned by network:floatingip {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:21:33.407932 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f4411589-cd79-486e-9228-b8a903a2d85e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.442862 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4411589-cd79-486e-9228-b8a903a2d85e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b1aa582f-63d4-4eb5-9800-f32d041803cf,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:33.516115 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-dcb95606-0291-4054-a023-930cdd9cfe4c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.530184 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f4411589-cd79-486e-9228-b8a903a2d85e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.531462 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-f4411589-cd79-486e-9228-b8a903a2d85e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.3990264 Nov 11 17:21:33.534998 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 35238) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:33.539392 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-887d40dc-bfc7-4331-9dce-a739e15600f0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Request body: {'security_group_rule': {'security_group_id': 'b1aa582f-63d4-4eb5-9800-f32d041803cf', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:21:33.584139 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5612c57c-077a-4de2-8643-aa4159edb9db tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.608438 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5612c57c-077a-4de2-8643-aa4159edb9db tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Pushing event deleted for resources: {'Port': ['ID=b300149d-6b5d-4954-a7d9-daf56ede73a9,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:33.647169 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-887d40dc-bfc7-4331-9dce-a739e15600f0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.674181 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5612c57c-077a-4de2-8643-aa4159edb9db tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks [] for floatingip, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.677705 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-5612c57c-077a-4de2-8643-aa4159edb9db tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.681821 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-5612c57c-077a-4de2-8643-aa4159edb9db tempest-AttachVolumeShelveTestJSON-1174829700 tempest-AttachVolumeShelveTestJSON-1174829700-project] 10.222.0.16 "DELETE /v2.0/floatingips/047e3c82-79fa-478c-86dc-decb34ef9559 HTTP/1.1" status: 204 len: 168 time: 0.5445433 Nov 11 17:21:33.707501 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-887d40dc-bfc7-4331-9dce-a739e15600f0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.796293 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-887d40dc-bfc7-4331-9dce-a739e15600f0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.815057 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-887d40dc-bfc7-4331-9dce-a739e15600f0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6cabaac7-5afd-4161-94f9-d941a8aea3d3,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:33.884260 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-887d40dc-bfc7-4331-9dce-a739e15600f0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:33.885476 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-887d40dc-bfc7-4331-9dce-a739e15600f0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3495300 Nov 11 17:21:33.888340 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 35242) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:33.892781 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-64ae4533-b105-46d4-b517-c598c69ccb51 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Request body: {'security_group_rule': {'security_group_id': 'b1aa582f-63d4-4eb5-9800-f32d041803cf', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:21:34.007337 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-64ae4533-b105-46d4-b517-c598c69ccb51 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:34.065103 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-64ae4533-b105-46d4-b517-c598c69ccb51 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:34.138973 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-64ae4533-b105-46d4-b517-c598c69ccb51 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:34.158083 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64ae4533-b105-46d4-b517-c598c69ccb51 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=22bd3b45-e42a-4b67-8fed-e59cc867bd2e,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:34.244510 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-64ae4533-b105-46d4-b517-c598c69ccb51 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:34.246313 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-64ae4533-b105-46d4-b517-c598c69ccb51 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3562889 Nov 11 17:21:34.249072 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 35246) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:34.253805 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Request body: {'floatingip': {'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:21:34.379760 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for floatingip, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:34.479815 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:34.585806 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Allocated IP 172.27.1.240 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/3fd245e1-8159-48d0-9809-2fa73db43aeb) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:21:34.636673 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:34.688184 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:34.790789 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:34.831725 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:21:34.836383 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:21:34.838684 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:21:34.844885 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event updated for resources: {'Port': ['ID=3fd245e1-8159-48d0-9809-2fa73db43aeb,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:34.928721 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:35.040334 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:35.192352 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:35.287562 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:35.357357 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event updated for resources: {'Port': ['ID=3fd245e1-8159-48d0-9809-2fa73db43aeb,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:35.368119 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:35.461833 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:35.463187 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-7620d1c8-e24e-4d80-b7bb-03b86aeb3e74 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.2130704 Nov 11 17:21:35.660686 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a6322676-8668-42bb-81ec-1dd483538d60 req-3890070e-ccec-4aa5-8716-a43ed52af23f tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-securitygroup--334016335&fields=id&tenant_id=7e951c2eae284261a98b317ec84140db HTTP/1.1" status: 200 len: 267 time: 0.0428646 Nov 11 17:21:36.021834 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6322676-8668-42bb-81ec-1dd483538d60 req-bab37a22-0eba-4209-a361-3fcf926ca6d3 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:36.023383 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a6322676-8668-42bb-81ec-1dd483538d60 req-bab37a22-0eba-4209-a361-3fcf926ca6d3 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/networks?id=10ac93d3-f14d-4df5-a044-d683e35c1ab8 HTTP/1.1" status: 200 len: 811 time: 0.3561335 Nov 11 17:21:36.038214 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a6322676-8668-42bb-81ec-1dd483538d60 req-73229158-a7fe-460f-8b49-d6f96cb7e702 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/quotas/7e951c2eae284261a98b317ec84140db HTTP/1.1" status: 200 len: 375 time: 0.0091739 Nov 11 17:21:36.091823 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a6322676-8668-42bb-81ec-1dd483538d60 req-8a84e6ff-3e5a-4413-8c82-59d91e15f2e3 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=7e951c2eae284261a98b317ec84140db&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0478361 Nov 11 17:21:36.189364 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a6322676-8668-42bb-81ec-1dd483538d60 req-93faaf5a-69c0-4a79-a0cb-2863f6746aee service neutron] 10.222.0.16 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859220 Nov 11 17:21:36.285176 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a6322676-8668-42bb-81ec-1dd483538d60 req-7cacc36f-58b9-44ab-ab3e-9e9f5431934e service neutron] 10.222.0.16 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889719 Nov 11 17:21:36.350252 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:36.444013 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 35278) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:36.626297 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-310c9d8c-c757-4d0f-9313-d28d22d3d173 req-cdd860fb-3649-412b-b04a-f7c5552b9a18 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 210 time: 0.0385857 Nov 11 17:21:36.934057 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-cbb6b895-b677-47fa-a840-1da506117ab8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-394221'] for router_interface, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:37.030487 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:37.184443 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-cbb6b895-b677-47fa-a840-1da506117ab8 admin admin] Deleting port aa2fc75b-4ee8-4417-b781-eb1c551f1c43 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:21:37.185155 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-cbb6b895-b677-47fa-a840-1da506117ab8 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:37.264977 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-cbb6b895-b677-47fa-a840-1da506117ab8 admin admin] For port aa2fc75b-4ee8-4417-b781-eb1c551f1c43, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=aa2fc75b-4ee8-4417-b781-eb1c551f1c43,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:21:37.265362 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-cbb6b895-b677-47fa-a840-1da506117ab8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:37.277817 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-cbb6b895-b677-47fa-a840-1da506117ab8 admin admin] Calling delete_port for aa2fc75b-4ee8-4417-b781-eb1c551f1c43 owned by network:router_interface {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:21:37.561205 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-cbb6b895-b677-47fa-a840-1da506117ab8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:37.588332 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbb6b895-b677-47fa-a840-1da506117ab8 admin admin] Pushing event deleted for resources: {'Port': ['ID=aa2fc75b-4ee8-4417-b781-eb1c551f1c43,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:37.739780 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-067d5534-2182-4d8a-a75f-af33b97948a6 req-8ca1d735-25cc-4d23-b624-7e1de39c0a1e tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 210 time: 0.0356400 Nov 11 17:21:37.780432 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-cbb6b895-b677-47fa-a840-1da506117ab8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8103781', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-393853'] for router_interface, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:38.006295 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cbb6b895-b677-47fa-a840-1da506117ab8 admin admin] Router 1a70d97d-215a-45d3-ba2b-b538e79a3278 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:21:38.130309 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cbb6b895-b677-47fa-a840-1da506117ab8 admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:21:38.136063 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-cbb6b895-b677-47fa-a840-1da506117ab8 admin admin] 10.222.0.16 "PUT /v2.0/routers/1a70d97d-215a-45d3-ba2b-b538e79a3278/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6906743 Nov 11 17:21:38.138769 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 35294) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:38.139791 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f95d6013-f276-4a65-9432-ac12ca7ed8fd None None] Sync routers for ids ['1a70d97d-215a-45d3-ba2b-b538e79a3278'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:21:38.152347 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f95d6013-f276-4a65-9432-ac12ca7ed8fd None None] Routers {'1a70d97d-215a-45d3-ba2b-b538e79a3278'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:21:38.152960 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-f95d6013-f276-4a65-9432-ac12ca7ed8fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:21:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1a70d97d-215a-45d3-ba2b-b538e79a3278'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:38.244826 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6f6a1e3d-a8d0-47fd-96c5-588bbe930c5e admin admin] Publish callbacks [] for router, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:38.259967 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-f95d6013-f276-4a65-9432-ac12ca7ed8fd None None] Set router 1a70d97d-215a-45d3-ba2b-b538e79a3278 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:21:38.348118 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6f6a1e3d-a8d0-47fd-96c5-588bbe930c5e admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:38.445341 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-f95d6013-f276-4a65-9432-ac12ca7ed8fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214'}], 'enable_snat': True}, 'gw_port_id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:21:37Z', 'revision_number': 5, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port': {'id': '1b86e4c7-3038-4da7-86dc-0cffda8e7830', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b3:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:14:11Z', 'updated_at': '2021-11-11T17:14:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:38.472405 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f95d6013-f276-4a65-9432-ac12ca7ed8fd None None] Checking router: 1a70d97d-215a-45d3-ba2b-b538e79a3278 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:21:38.481156 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f95d6013-f276-4a65-9432-ac12ca7ed8fd None None] Routers {'1a70d97d-215a-45d3-ba2b-b538e79a3278'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:21:38.481759 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-f95d6013-f276-4a65-9432-ac12ca7ed8fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:21:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1a70d97d-215a-45d3-ba2b-b538e79a3278'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:38.562032 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-6f6a1e3d-a8d0-47fd-96c5-588bbe930c5e admin admin] Deleting port 1b86e4c7-3038-4da7-86dc-0cffda8e7830 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:21:38.562608 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6f6a1e3d-a8d0-47fd-96c5-588bbe930c5e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:38.571778 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6322676-8668-42bb-81ec-1dd483538d60 req-47141e70-1358-45ff-983f-df14a1ab26b9 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:38.575081 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a6322676-8668-42bb-81ec-1dd483538d60 req-47141e70-1358-45ff-983f-df14a1ab26b9 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.10 "GET /v2.0/networks?id=10ac93d3-f14d-4df5-a044-d683e35c1ab8 HTTP/1.1" status: 200 len: 811 time: 0.1404791 Nov 11 17:21:38.575865 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-f95d6013-f276-4a65-9432-ac12ca7ed8fd None None] Set router 1a70d97d-215a-45d3-ba2b-b538e79a3278 gateway port host: None {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:21:38.638044 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-f95d6013-f276-4a65-9432-ac12ca7ed8fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:21:38Z', 'revision_number': 6, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port_host': None}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:38.664898 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f95d6013-f276-4a65-9432-ac12ca7ed8fd None None] The sync data for ids ['1a70d97d-215a-45d3-ba2b-b538e79a3278'] in dv-cinder-694140-2-iscsi is: [{'id': '1a70d97d-215a-45d3-ba2b-b538e79a3278', 'name': 'tempest-AttachVolumeShelveTestJSON-517002489-router', 'tenant_id': '3a6e5bdc578b460ab28a883efa598f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:14:10Z', 'updated_at': '2021-11-11T17:21:38Z', 'revision_number': 6, 'project_id': '3a6e5bdc578b460ab28a883efa598f95', 'gw_port_host': None}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:21:38.699917 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-6f6a1e3d-a8d0-47fd-96c5-588bbe930c5e admin admin] For port 1b86e4c7-3038-4da7-86dc-0cffda8e7830, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=1b86e4c7-3038-4da7-86dc-0cffda8e7830,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:21:38.700307 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6f6a1e3d-a8d0-47fd-96c5-588bbe930c5e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:38.707812 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a6322676-8668-42bb-81ec-1dd483538d60 req-d7b0229e-739b-4eb7-8143-0d990c698640 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=7e951c2eae284261a98b317ec84140db HTTP/1.1" status: 200 len: 379 time: 0.1164327 Nov 11 17:21:38.719673 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-6f6a1e3d-a8d0-47fd-96c5-588bbe930c5e admin admin] Calling delete_port for 1b86e4c7-3038-4da7-86dc-0cffda8e7830 owned by network:router_gateway {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:21:38.725794 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-a6322676-8668-42bb-81ec-1dd483538d60 req-dc215d51-fb5a-4b72-818a-bab3aafea5f2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Request body: {'port': {'device_id': '7d89b9bb-0141-4476-b119-26030b8f1e11', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'admin_state_up': True, 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'security_groups': ['b1aa582f-63d4-4eb5-9800-f32d041803cf']}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:21:38.856402 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6e042a93-509f-4b92-bb7d-95b7780e9e77 req-72010e45-2831-4fc1-bf1e-41cae57e5a3d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 210 time: 0.0390270 Nov 11 17:21:39.316162 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a6322676-8668-42bb-81ec-1dd483538d60 req-dc215d51-fb5a-4b72-818a-bab3aafea5f2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Made reservation on behalf of 7e951c2eae284261a98b317ec84140db for: {'port': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:21:39.319799 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-a6322676-8668-42bb-81ec-1dd483538d60 req-dc215d51-fb5a-4b72-818a-bab3aafea5f2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:39.342726 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6f6a1e3d-a8d0-47fd-96c5-588bbe930c5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:39.407988 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f6a1e3d-a8d0-47fd-96c5-588bbe930c5e admin admin] Pushing event deleted for resources: {'Port': ['ID=1b86e4c7-3038-4da7-86dc-0cffda8e7830,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:39.510624 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6f6a1e3d-a8d0-47fd-96c5-588bbe930c5e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-397207'] for router_gateway, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:39.518738 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 1b86e4c7-3038-4da7-86dc-0cffda8e7830 no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:21:39.544599 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: 1b86e4c7-3038-4da7-86dc-0cffda8e7830 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:21:39.545196 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 1b86e4c7-3038-4da7-86dc-0cffda8e7830 not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:21:39.545791 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device aa2fc75b-4ee8-4417-b781-eb1c551f1c43 no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:21:39.566137 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: aa2fc75b-4ee8-4417-b781-eb1c551f1c43 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:21:39.566490 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device aa2fc75b-4ee8-4417-b781-eb1c551f1c43 not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:21:39.605103 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [req-a6322676-8668-42bb-81ec-1dd483538d60 req-dc215d51-fb5a-4b72-818a-bab3aafea5f2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Allocated IP 172.20.0.8 (10ac93d3-f14d-4df5-a044-d683e35c1ab8/cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba/e641e657-04f2-4767-a7ef-934e2ccd7a0b) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:21:39.614263 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6f6a1e3d-a8d0-47fd-96c5-588bbe930c5e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-424448', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7353'] for router, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:39.619282 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6f6a1e3d-a8d0-47fd-96c5-588bbe930c5e admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:39.756089 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6f6a1e3d-a8d0-47fd-96c5-588bbe930c5e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-424459'] for router, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:39.756522 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6f6a1e3d-a8d0-47fd-96c5-588bbe930c5e admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1a70d97d-215a-45d3-ba2b-b538e79a3278 {{(pid=102323) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 17:21:39.781015 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6f6a1e3d-a8d0-47fd-96c5-588bbe930c5e admin admin] Publish callbacks [] for router, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:39.781015 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-6f6a1e3d-a8d0-47fd-96c5-588bbe930c5e admin admin] 10.222.0.16 "DELETE /v2.0/routers/1a70d97d-215a-45d3-ba2b-b538e79a3278 HTTP/1.1" status: 204 len: 168 time: 1.6276643 Nov 11 17:21:39.781224 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 35302) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:39.793142 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-a6322676-8668-42bb-81ec-1dd483538d60 req-dc215d51-fb5a-4b72-818a-bab3aafea5f2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:39.829290 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_v2 [None req-57fbd4bb-1fea-4688-a3fa-cbc1547f9f09 admin admin] Deleting subnet 1a4b11d7-2160-49c3-be78-265f0700c580 {{(pid=102324) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:21:39.834713 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-57fbd4bb-1fea-4688-a3fa-cbc1547f9f09 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:39.876180 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-57fbd4bb-1fea-4688-a3fa-cbc1547f9f09 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5895837'] for subnet, precommit_delete_associations {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:39.916775 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-a6322676-8668-42bb-81ec-1dd483538d60 req-dc215d51-fb5a-4b72-818a-bab3aafea5f2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:39.966236 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a6322676-8668-42bb-81ec-1dd483538d60 req-dc215d51-fb5a-4b72-818a-bab3aafea5f2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:21:39.971482 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [req-a6322676-8668-42bb-81ec-1dd483538d60 req-dc215d51-fb5a-4b72-818a-bab3aafea5f2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:21:39.973928 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [req-a6322676-8668-42bb-81ec-1dd483538d60 req-dc215d51-fb5a-4b72-818a-bab3aafea5f2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:21:40.007878 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc215d51-fb5a-4b72-818a-bab3aafea5f2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event updated for resources: {'Port': ['ID=e641e657-04f2-4767-a7ef-934e2ccd7a0b,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:40.022187 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-57fbd4bb-1fea-4688-a3fa-cbc1547f9f09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.035943 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6322676-8668-42bb-81ec-1dd483538d60 req-dc215d51-fb5a-4b72-818a-bab3aafea5f2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:40.036608 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-a6322676-8668-42bb-81ec-1dd483538d60 req-dc215d51-fb5a-4b72-818a-bab3aafea5f2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.054433 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b33f0821-a6c0-430c-b856-9092a1d54568 req-a72890a1-1aef-4bb2-afee-c0ffb6789afe tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:40.056018 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b33f0821-a6c0-430c-b856-9092a1d54568 req-a72890a1-1aef-4bb2-afee-c0ffb6789afe tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 931 time: 0.1190126 Nov 11 17:21:40.121301 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b33f0821-a6c0-430c-b856-9092a1d54568 req-418513d4-2d92-40ee-a6a9-57a4572f204d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=b1aa582f-63d4-4eb5-9800-f32d041803cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0583735 Nov 11 17:21:40.129133 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a6322676-8668-42bb-81ec-1dd483538d60 req-dc215d51-fb5a-4b72-818a-bab3aafea5f2 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.4073713 Nov 11 17:21:40.147071 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Request body: {'port': {'device_id': '7d89b9bb-0141-4476-b119-26030b8f1e11', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:21:40.179205 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-dc27087e-1dbc-426e-ac55-c58e93d55980 None None] Provisioning complete for port e641e657-04f2-4767-a7ef-934e2ccd7a0b triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:21:40.179697 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-dc27087e-1dbc-426e-ac55-c58e93d55980 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.203212 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.208123 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-57fbd4bb-1fea-4688-a3fa-cbc1547f9f09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5436208', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5275461'] for subnet, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.218132 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-dc27087e-1dbc-426e-ac55-c58e93d55980 None None] Port e641e657-04f2-4767-a7ef-934e2ccd7a0b cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:21:40.242575 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57fbd4bb-1fea-4688-a3fa-cbc1547f9f09 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1a4b11d7-2160-49c3-be78-265f0700c580,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:40.247814 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-57fbd4bb-1fea-4688-a3fa-cbc1547f9f09 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.251286 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-57fbd4bb-1fea-4688-a3fa-cbc1547f9f09 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/1a4b11d7-2160-49c3-be78-265f0700c580 HTTP/1.1" status: 204 len: 168 time: 0.4794559 Nov 11 17:21:40.254123 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 35306) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:40.255144 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68c0c33c-6aa6-46f3-8aae-3af58a7b0f0c None None] Network 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:21:40.323257 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.382668 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] Deleting port eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:21:40.383013 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.449287 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] DHCP port deletion for 4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f request from dv-cinder-694140-2-iscsi {{(pid=102325) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 11 17:21:40.461924 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] For port eb0a576a-e1ce-45fe-9e7c-89942be0d1e7, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=eb0a576a-e1ce-45fe-9e7c-89942be0d1e7,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:21:40.462303 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.477836 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] Calling delete_port for eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 owned by network:dhcp {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:21:40.506452 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Deleting port eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 {{(pid=102325) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:21:40.507348 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.510834 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e641e657-04f2-4767-a7ef-934e2ccd7a0b {{(pid=102323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:21:40.519220 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.532996 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.provisioning_blocks [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Transition to ACTIVE for port object e641e657-04f2-4767-a7ef-934e2ccd7a0b will not be triggered until provisioned by entity L2. {{(pid=102323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:21:40.577736 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] For port eb0a576a-e1ce-45fe-9e7c-89942be0d1e7, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=eb0a576a-e1ce-45fe-9e7c-89942be0d1e7,segment=NetworkSegment(47be9a7f-0eae-411b-a3de-e2c448d6c842),segment_id=47be9a7f-0eae-411b-a3de-e2c448d6c842)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:21:40.578371 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.584579 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.592001 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Calling delete_port for eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 owned by network:dhcp {{(pid=102325) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:21:40.612863 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.641514 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Pushing event updated for resources: {'Port': ['ID=e641e657-04f2-4767-a7ef-934e2ccd7a0b,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:40.656198 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] No DVR routers for this DVR port eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 on host dv-cinder-694140-2-iscsi {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:21:40.658319 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] Pushing event deleted for resources: {'Port': ['ID=eb0a576a-e1ce-45fe-9e7c-89942be0d1e7,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:40.726325 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Attempting to bind port e641e657-04f2-4767-a7ef-934e2ccd7a0b on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:21:40.727533 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Attempting to bind port e641e657-04f2-4767-a7ef-934e2ccd7a0b by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:21:40.728041 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Attempting to bind port e641e657-04f2-4767-a7ef-934e2ccd7a0b on network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:21:40.735917 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Port e641e657-04f2-4767-a7ef-934e2ccd7a0b on network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:21:40.736248 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Attempting to bind port e641e657-04f2-4767-a7ef-934e2ccd7a0b on network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:21:40.741564 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633'] for port, after_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.742161 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.743766 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 21, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:21:40.744814 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Checking segment: {'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:21:40.745278 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Bound using segment: {'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:21:40.751033 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Bound port: e641e657-04f2-4767-a7ef-934e2ccd7a0b, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '41c0a3f1-0319-4822-972b-4361c6e0b0df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8'}}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:21:40.751033 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.766926 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f']}} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:40.777391 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '47be9a7f-0eae-411b-a3de-e2c448d6c842') {'for_net_delete': True} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:40.777735 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '47be9a7f-0eae-411b-a3de-e2c448d6c842') {} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:40.782946 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] No DVR routers for this DVR port eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 on host dv-cinder-694140-2-iscsi {{(pid=102325) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:21:40.787137 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Pushing event deleted for resources: {'Port': ['ID=eb0a576a-e1ce-45fe-9e7c-89942be0d1e7,revision_number=None']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:40.788619 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5895812'] for segment, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.796980 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:40.797327 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:40.797672 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:40.798002 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:40.798330 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:40.798686 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:40.799013 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:40.800034 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:40.800373 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:40.801296 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:40.801645 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:40.801971 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c04540ea-a6bc-4af2-89dc-4e93fe2c7bc2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:21:40.807459 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.814570 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] Releasing vlan 538 on physical network physnet1 to pool {{(pid=102324) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:21:40.815565 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5436270'] for segment, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.837275 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] For port e641e657-04f2-4767-a7ef-934e2ccd7a0b, host hv-cinder-69414, cleared binding levels {{(pid=102323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:21:40.842746 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] For port e641e657-04f2-4767-a7ef-934e2ccd7a0b, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=e641e657-04f2-4767-a7ef-934e2ccd7a0b,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: Traceback (most recent call last): Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: timer() Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: cb(*args, **kw) Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: return func(*args, **kwargs) Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: self._notify() Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: self.callback(batched_events) Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: event.method(event) Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: return f(self, *a, **k) Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: return self._get(url).json() Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: return self.request(url, 'GET', **kwargs) Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:21:40.865936 dv-cinder-694140-2-iscsi neutron-server[102324]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:21:40.916694 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.938989 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.946357 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.949617 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] 10.222.0.16 "DELETE /v2.0/networks/4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f HTTP/1.1" status: 204 len: 168 time: 0.6944149 Nov 11 17:21:40.962916 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:40.963563 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:40.964957 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] 10.222.0.10 "PUT /v2.0/ports/e641e657-04f2-4767-a7ef-934e2ccd7a0b HTTP/1.1" status: 200 len: 1093 time: 0.8224480 Nov 11 17:21:40.965771 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7d89b9bb-0141-4476-b119-26030b8f1e11', 'tag': 'e641e657-04f2-4767-a7ef-934e2ccd7a0b'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:21:40.968099 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b75ee867-1f4d-4e39-ace9-60e5d278d811" -d '{"events": [{"name": "network-changed", "server_uuid": "7d89b9bb-0141-4476-b119-26030b8f1e11", "tag": "e641e657-04f2-4767-a7ef-934e2ccd7a0b"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:21:40.972795 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11a3d015-3247-41d8-bcd0-7f987f5e1ed3 admin admin] Pushing event deleted for resources: {'Network': ['ID=4881c13f-9f29-4bd8-b9ed-9f38cc21fb1f,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:40.999693 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a931e894-bd60-4e12-bd42-2ed6066f0e74 service neutron] Pushing event updated for resources: {'Port': ['ID=e641e657-04f2-4767-a7ef-934e2ccd7a0b,revision_number=3']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:41.017494 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:21:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7de32dfc-bf67-4f54-ba78-ca65352b03b4 x-openstack-request-id: req-7de32dfc-bf67-4f54-ba78-ca65352b03b4 {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:21:41.017866 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7d89b9bb-0141-4476-b119-26030b8f1e11", "tag": "e641e657-04f2-4767-a7ef-934e2ccd7a0b", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:21:41.018211 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-7de32dfc-bf67-4f54-ba78-ca65352b03b4 {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:21:41.018732 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7d89b9bb-0141-4476-b119-26030b8f1e11', 'tag': 'e641e657-04f2-4767-a7ef-934e2ccd7a0b', 'status': 'completed', 'code': 200} Nov 11 17:21:41.093363 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b75ee867-1f4d-4e39-ace9-60e5d278d811 req-68cb5ec0-19c3-48f7-8971-be1f0e2aaa0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:41.093740 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b75ee867-1f4d-4e39-ace9-60e5d278d811 req-68cb5ec0-19c3-48f7-8971-be1f0e2aaa0c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=7e951c2eae284261a98b317ec84140db&device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 1096 time: 0.0503442 Nov 11 17:21:41.210895 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b75ee867-1f4d-4e39-ace9-60e5d278d811 req-779012c7-e9ce-413e-8d73-ab0edae60428 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:41.212871 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b75ee867-1f4d-4e39-ace9-60e5d278d811 req-779012c7-e9ce-413e-8d73-ab0edae60428 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=7e951c2eae284261a98b317ec84140db&shared=False HTTP/1.1" status: 200 len: 912 time: 0.1090915 Nov 11 17:21:41.265799 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0da0ad04-c722-46cd-9f71-a4b1fbcb0190 req-db815127-f649-4f41-8af9-3c10c145496a tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:41.267323 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0da0ad04-c722-46cd-9f71-a4b1fbcb0190 req-db815127-f649-4f41-8af9-3c10c145496a tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 943 time: 0.0498931 Nov 11 17:21:41.315993 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 35314) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:41.320182 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0da0ad04-c722-46cd-9f71-a4b1fbcb0190 req-e6cf54a1-352e-46a5-a2db-18e3c969c4f0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=b1aa582f-63d4-4eb5-9800-f32d041803cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466123 Nov 11 17:21:41.324960 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b75ee867-1f4d-4e39-ace9-60e5d278d811 req-a85d4a5e-cabb-420f-88c5-64e34970f487 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:41.326350 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b75ee867-1f4d-4e39-ace9-60e5d278d811 req-a85d4a5e-cabb-420f-88c5-64e34970f487 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1018426 Nov 11 17:21:41.369670 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-ad7da150-0289-473c-92d7-0978c3c06281 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=3a6e5bdc578b460ab28a883efa598f95&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0524681 Nov 11 17:21:41.372379 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 35316) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:41.411737 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6322676-8668-42bb-81ec-1dd483538d60 req-078ac5a4-9054-4f5e-beb6-dc978d9c640d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:41.413235 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a6322676-8668-42bb-81ec-1dd483538d60 req-078ac5a4-9054-4f5e-beb6-dc978d9c640d service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=7e951c2eae284261a98b317ec84140db&device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 1096 time: 0.0426018 Nov 11 17:21:41.435085 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a783a40c-9bc3-43d1-81b8-884ceaeade41 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:41.464342 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a783a40c-9bc3-43d1-81b8-884ceaeade41 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:41.464698 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a6322676-8668-42bb-81ec-1dd483538d60 req-1873a656-0492-469b-9257-27d2b8367f4f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e641e657-04f2-4767-a7ef-934e2ccd7a0b HTTP/1.1" status: 200 len: 217 time: 0.0400782 Nov 11 17:21:41.535059 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:21:41.543719 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a97349dc-72ef-459d-bfdc-e849008afa5f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:41.545189 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a6322676-8668-42bb-81ec-1dd483538d60 req-a97349dc-72ef-459d-bfdc-e849008afa5f service neutron] 10.222.0.10 "GET /v2.0/subnets?id=cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba HTTP/1.1" status: 200 len: 850 time: 0.0695112 Nov 11 17:21:41.556989 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:21:41.563988 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device eb0a576a-e1ce-45fe-9e7c-89942be0d1e7 not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:21:41.578506 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a783a40c-9bc3-43d1-81b8-884ceaeade41 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:41.581302 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a783a40c-9bc3-43d1-81b8-884ceaeade41 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:41.582862 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-a783a40c-9bc3-43d1-81b8-884ceaeade41 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/96bc1adc-db69-46ac-b26d-3dc384499944 HTTP/1.1" status: 204 len: 168 time: 0.2094707 Nov 11 17:21:41.593613 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a783a40c-9bc3-43d1-81b8-884ceaeade41 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=96bc1adc-db69-46ac-b26d-3dc384499944,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:41.602815 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6322676-8668-42bb-81ec-1dd483538d60 req-970b1a25-b1f1-46ed-81e0-6cfaad027171 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:41.604657 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a6322676-8668-42bb-81ec-1dd483538d60 req-970b1a25-b1f1-46ed-81e0-6cfaad027171 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=10ac93d3-f14d-4df5-a044-d683e35c1ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0494142 Nov 11 17:21:41.705430 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a6322676-8668-42bb-81ec-1dd483538d60 req-1b22cbf5-53be-4286-adf1-02f270311599 service neutron] 10.222.0.10 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0891182 Nov 11 17:21:41.821533 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a6322676-8668-42bb-81ec-1dd483538d60 req-4ed4aa00-4123-4728-85d6-9f1b4b3eb7ef service neutron] 10.222.0.10 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1045709 Nov 11 17:21:42.447680 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8836d7b-4a9a-4ea3-b3ee-029f1450af69 req-64075271-7b6b-4f98-bc5c-6c0a5b24b412 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:42.449180 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a8836d7b-4a9a-4ea3-b3ee-029f1450af69 req-64075271-7b6b-4f98-bc5c-6c0a5b24b412 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 943 time: 0.0603702 Nov 11 17:21:42.502373 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a8836d7b-4a9a-4ea3-b3ee-029f1450af69 req-2480ddb8-dd11-46f3-b099-882b675d36f4 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=b1aa582f-63d4-4eb5-9800-f32d041803cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466061 Nov 11 17:21:43.616579 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5776cb3-6634-4e0c-9b4c-effed7e9ad2b req-16c1a9cc-7a5d-43f7-9f7a-9b0d060312ac tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:43.618112 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d5776cb3-6634-4e0c-9b4c-effed7e9ad2b req-16c1a9cc-7a5d-43f7-9f7a-9b0d060312ac tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 943 time: 0.0486379 Nov 11 17:21:43.670335 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d5776cb3-6634-4e0c-9b4c-effed7e9ad2b req-613e2166-6564-4133-96f5-cc3282178d07 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=b1aa582f-63d4-4eb5-9800-f32d041803cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460012 Nov 11 17:21:44.788969 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac7c5a2-1d73-4565-900d-296c3e41de9e req-da9a23d0-b92a-4f91-ab0e-dd9d6eb1ee6d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:44.790442 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9ac7c5a2-1d73-4565-900d-296c3e41de9e req-da9a23d0-b92a-4f91-ab0e-dd9d6eb1ee6d tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 943 time: 0.0521264 Nov 11 17:21:44.838320 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9ac7c5a2-1d73-4565-900d-296c3e41de9e req-2923f804-b9f7-463b-b7dd-d956b31841c8 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=b1aa582f-63d4-4eb5-9800-f32d041803cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419188 Nov 11 17:21:45.955960 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60004063-beeb-4f72-baba-b40ecefaa9ac req-eb9918a6-7dea-44d7-a721-3687f0d20a60 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:45.957471 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-60004063-beeb-4f72-baba-b40ecefaa9ac req-eb9918a6-7dea-44d7-a721-3687f0d20a60 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 943 time: 0.0534186 Nov 11 17:21:46.004101 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-60004063-beeb-4f72-baba-b40ecefaa9ac req-e0132967-33d2-472a-87c7-b26400007fc5 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=b1aa582f-63d4-4eb5-9800-f32d041803cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405934 Nov 11 17:21:47.001433 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:47.129232 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2bcda2b-8fcc-4747-b589-ec82a123590e req-215aab08-d627-493e-84fa-c7f0b7909733 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:47.132597 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c2bcda2b-8fcc-4747-b589-ec82a123590e req-215aab08-d627-493e-84fa-c7f0b7909733 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 943 time: 0.0549412 Nov 11 17:21:47.181730 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c2bcda2b-8fcc-4747-b589-ec82a123590e req-4927aab5-f5d1-403c-a178-ae8c10e5f285 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=b1aa582f-63d4-4eb5-9800-f32d041803cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446794 Nov 11 17:21:48.301120 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54497621-ddb8-434e-926c-6e1d916c6be6 req-05fde012-34ca-4d0d-ba6a-3d68c44150e3 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:48.302675 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-54497621-ddb8-434e-926c-6e1d916c6be6 req-05fde012-34ca-4d0d-ba6a-3d68c44150e3 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 943 time: 0.0484929 Nov 11 17:21:48.351539 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-54497621-ddb8-434e-926c-6e1d916c6be6 req-da23ce2a-3dbb-4120-bbcd-a8f66664fc25 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=b1aa582f-63d4-4eb5-9800-f32d041803cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424185 Nov 11 17:21:49.323307 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device e641e657-04f2-4767-a7ef-934e2ccd7a0b details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:21:49.425805 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port e641e657-04f2-4767-a7ef-934e2ccd7a0b, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=e641e657-04f2-4767-a7ef-934e2ccd7a0b,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:21:49.447931 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': 'e641e657-04f2-4767-a7ef-934e2ccd7a0b', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'port_id': 'e641e657-04f2-4767-a7ef-934e2ccd7a0b', 'mac_address': 'fa:16:3e:b8:90:53', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 544, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:21:49.482616 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f18be4-f500-4c1f-bcaa-9f0de29bd892 req-e4894850-56ae-4f74-b3ed-b1ebea80bff0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:49.484114 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b8f18be4-f500-4c1f-bcaa-9f0de29bd892 req-e4894850-56ae-4f74-b3ed-b1ebea80bff0 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 943 time: 0.0641513 Nov 11 17:21:49.489615 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:49.504240 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e641e657-04f2-4767-a7ef-934e2ccd7a0b {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:21:49.524934 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port e641e657-04f2-4767-a7ef-934e2ccd7a0b, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=e641e657-04f2-4767-a7ef-934e2ccd7a0b,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:21:49.537394 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b8f18be4-f500-4c1f-bcaa-9f0de29bd892 req-357c936b-1407-4a18-8f28-8f33336adf19 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=b1aa582f-63d4-4eb5-9800-f32d041803cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0468483 Nov 11 17:21:49.584755 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:49.633896 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=e641e657-04f2-4767-a7ef-934e2ccd7a0b,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:49.876393 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['e641e657-04f2-4767-a7ef-934e2ccd7a0b'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:21:50.550433 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-4a289846-74bc-4a67-8726-0deb62f317c7 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1848309604&fields=id&tenant_id=10bedfb35d1e481aa78e025489c1be2d HTTP/1.1" status: 200 len: 267 time: 0.0441010 Nov 11 17:21:50.661258 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efddb402-94fb-477b-894d-fc6c54be7811 req-d482caf3-6003-402a-a042-89b13be22282 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:50.662901 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-efddb402-94fb-477b-894d-fc6c54be7811 req-d482caf3-6003-402a-a042-89b13be22282 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 944 time: 0.0510662 Nov 11 17:21:50.664657 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-bc01319f-c60f-4ef7-8d50-ff0863ac06fc tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:50.666106 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-bc01319f-c60f-4ef7-8d50-ff0863ac06fc tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/networks?id=45e6626a-2007-490b-a445-d7c3baea689e HTTP/1.1" status: 200 len: 811 time: 0.1088371 Nov 11 17:21:50.681182 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-19ed1fa0-fdca-4631-8a4f-0e0046345147 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/quotas/10bedfb35d1e481aa78e025489c1be2d HTTP/1.1" status: 200 len: 375 time: 0.0091271 Nov 11 17:21:50.714502 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-efddb402-94fb-477b-894d-fc6c54be7811 req-1557e948-5ce6-40ae-9771-5c93daaf1e3c tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=b1aa582f-63d4-4eb5-9800-f32d041803cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445154 Nov 11 17:21:50.739777 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-ddaa5855-bbd7-4eda-be72-dc5256b18018 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0528307 Nov 11 17:21:50.841103 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-b77e2602-76d8-45df-be1a-c1223d5e54fc service neutron] 10.222.0.16 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874178 Nov 11 17:21:50.930141 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-88b04cbb-9e60-48e9-a3ec-6338ce9d06c6 service neutron] 10.222.0.16 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828290 Nov 11 17:21:51.313954 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device e641e657-04f2-4767-a7ef-934e2ccd7a0b up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:21:51.429471 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port e641e657-04f2-4767-a7ef-934e2ccd7a0b completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:21:51.434225 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port e641e657-04f2-4767-a7ef-934e2ccd7a0b triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:21:51.434682 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:51.499192 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2b0ca916-d508-494e-bff8-74d86503cdb1 req-5201a12d-3a25-429a-ae28-15885fcd5361 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 210 time: 0.0478880 Nov 11 17:21:51.533403 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:51.560455 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7d89b9bb-0141-4476-b119-26030b8f1e11', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e641e657-04f2-4767-a7ef-934e2ccd7a0b'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:21:51.562858 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e8103c72-1968-4fef-b8ef-48ccf25a0f86" -d '{"events": [{"server_uuid": "7d89b9bb-0141-4476-b119-26030b8f1e11", "name": "network-vif-plugged", "status": "completed", "tag": "e641e657-04f2-4767-a7ef-934e2ccd7a0b"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:21:51.578440 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port e641e657-04f2-4767-a7ef-934e2ccd7a0b, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=e641e657-04f2-4767-a7ef-934e2ccd7a0b,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:21:51.606009 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:21:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-567e5b61-7010-4c9c-a996-be673c295aea x-openstack-request-id: req-567e5b61-7010-4c9c-a996-be673c295aea {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:21:51.606296 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7d89b9bb-0141-4476-b119-26030b8f1e11", "name": "network-vif-plugged", "status": "completed", "tag": "e641e657-04f2-4767-a7ef-934e2ccd7a0b", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:21:51.606565 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-567e5b61-7010-4c9c-a996-be673c295aea {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:21:51.606978 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7d89b9bb-0141-4476-b119-26030b8f1e11', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e641e657-04f2-4767-a7ef-934e2ccd7a0b', 'code': 200} Nov 11 17:21:51.709823 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:51.761795 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=e641e657-04f2-4767-a7ef-934e2ccd7a0b,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:51.831953 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-448f28e6-a6c7-471c-9e6d-c911a0261228 req-5c327fb9-d066-40f9-8840-fb975911d82f tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:51.833530 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-448f28e6-a6c7-471c-9e6d-c911a0261228 req-5c327fb9-d066-40f9-8840-fb975911d82f tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 945 time: 0.0494595 Nov 11 17:21:51.894617 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-448f28e6-a6c7-471c-9e6d-c911a0261228 req-43bf6bc4-3b7c-42d6-9f10-11a255a949fd tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=b1aa582f-63d4-4eb5-9800-f32d041803cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0532317 Nov 11 17:21:51.954683 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe13655b-bb23-4141-b351-25a0ad19b4e7 req-3e8c8df7-78ae-4cfa-92f2-948624320da4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:51.956611 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fe13655b-bb23-4141-b351-25a0ad19b4e7 req-3e8c8df7-78ae-4cfa-92f2-948624320da4 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 1098 time: 0.0421333 Nov 11 17:21:52.005263 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fe13655b-bb23-4141-b351-25a0ad19b4e7 req-9821ab27-8a11-4f6e-9e55-3e5069dba259 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=b1aa582f-63d4-4eb5-9800-f32d041803cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385401 Nov 11 17:21:52.592921 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cd9f238a-be1a-4d81-bc63-531878a10e65 req-eb9da569-595d-4984-a1cd-efe0e933f5e9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 210 time: 0.0319142 Nov 11 17:21:53.013294 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41996bd-f10e-4340-b885-40cc196c0413 req-c60f6757-adb1-4654-bcf1-c73d1da23445 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:53.015180 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d41996bd-f10e-4340-b885-40cc196c0413 req-c60f6757-adb1-4654-bcf1-c73d1da23445 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 945 time: 0.0510418 Nov 11 17:21:53.067266 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d41996bd-f10e-4340-b885-40cc196c0413 req-da347cb2-43d9-4ebc-bd3e-fe2f2d75ea69 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=b1aa582f-63d4-4eb5-9800-f32d041803cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421021 Nov 11 17:21:53.463541 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-a33ff0b7-c8e8-4ff5-b6c6-745461c4843d tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:53.466045 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-a33ff0b7-c8e8-4ff5-b6c6-745461c4843d tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.10 "GET /v2.0/networks?id=45e6626a-2007-490b-a445-d7c3baea689e HTTP/1.1" status: 200 len: 811 time: 0.1121073 Nov 11 17:21:53.549188 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-1692efb2-a0e4-4d6b-8fa3-4dfd3a96555a tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=10bedfb35d1e481aa78e025489c1be2d HTTP/1.1" status: 200 len: 380 time: 0.0735970 Nov 11 17:21:53.558286 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-9372482f-1623-4aac-8978-c9a3a36e8e4b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Request body: {'port': {'device_id': '7d756663-1f8a-4181-884f-ba0ae9a11772', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'admin_state_up': True, 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'security_groups': ['a3fcdc84-afa7-461b-8091-b146ab222f62']}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:21:53.687141 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e392096a-e763-4169-a952-44a5975713ab req-2ad342b8-2ffe-4818-9ddf-60497aab376a tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 210 time: 0.0258555 Nov 11 17:21:53.721600 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-9372482f-1623-4aac-8978-c9a3a36e8e4b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Made reservation on behalf of 10bedfb35d1e481aa78e025489c1be2d for: {'port': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:21:53.725148 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-9372482f-1623-4aac-8978-c9a3a36e8e4b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:53.854400 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-9372482f-1623-4aac-8978-c9a3a36e8e4b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Allocated IP 172.20.0.13 (45e6626a-2007-490b-a445-d7c3baea689e/bf78c82f-f2f3-4ef7-8052-be816dbd2df8/18cd1277-d6d0-48b5-bbbc-c0b112fe275f) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:21:53.995599 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-9372482f-1623-4aac-8978-c9a3a36e8e4b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:54.092983 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-9372482f-1623-4aac-8978-c9a3a36e8e4b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:54.140417 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-9372482f-1623-4aac-8978-c9a3a36e8e4b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Network 45e6626a-2007-490b-a445-d7c3baea689e is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:21:54.154063 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-9372482f-1623-4aac-8978-c9a3a36e8e4b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:21:54.178430 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-9372482f-1623-4aac-8978-c9a3a36e8e4b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:21:54.201472 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9372482f-1623-4aac-8978-c9a3a36e8e4b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event updated for resources: {'Port': ['ID=18cd1277-d6d0-48b5-bbbc-c0b112fe275f,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:54.239756 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-9372482f-1623-4aac-8978-c9a3a36e8e4b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:54.240486 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-9372482f-1623-4aac-8978-c9a3a36e8e4b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:54.252429 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d1ab09-32f8-43a8-b11f-34494ac31852 req-a2bc5eed-3869-4943-ba51-23f1ec808cbc tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:54.253997 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-06d1ab09-32f8-43a8-b11f-34494ac31852 req-a2bc5eed-3869-4943-ba51-23f1ec808cbc tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 945 time: 0.1102657 Nov 11 17:21:54.310881 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-06d1ab09-32f8-43a8-b11f-34494ac31852 req-ab91b324-fe01-42e8-8c28-124f87a535af tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=b1aa582f-63d4-4eb5-9800-f32d041803cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0503659 Nov 11 17:21:54.318571 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-9372482f-1623-4aac-8978-c9a3a36e8e4b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7639389 Nov 11 17:21:54.331077 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Request body: {'port': {'device_id': '7d756663-1f8a-4181-884f-ba0ae9a11772', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:21:54.386279 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:54.405439 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-e9286f68-6652-4ccf-9a9f-7324e15550db None None] Provisioning complete for port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:21:54.406470 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-e9286f68-6652-4ccf-9a9f-7324e15550db None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:54.440067 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf4c1270-14c6-412c-b235-625d5511a3de req-3affec75-8bc7-4107-b08b-bb950db62491 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:54.441814 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bf4c1270-14c6-412c-b235-625d5511a3de req-3affec75-8bc7-4107-b08b-bb950db62491 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 945 time: 0.0618212 Nov 11 17:21:54.447396 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-e9286f68-6652-4ccf-9a9f-7324e15550db None None] Port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:21:54.451650 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 35522) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:21:54.456396 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-7d1fc88d-9527-4c9c-bd07-96191f8ba4d5 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Request body: {'floatingip': {'port_id': 'e641e657-04f2-4767-a7ef-934e2ccd7a0b'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:21:54.496480 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7d1fc88d-9527-4c9c-bd07-96191f8ba4d5 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for floatingip, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:54.714155 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 18cd1277-d6d0-48b5-bbbc-c0b112fe275f {{(pid=102323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:21:54.722921 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:54.735778 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.provisioning_blocks [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Transition to ACTIVE for port object 18cd1277-d6d0-48b5-bbbc-c0b112fe275f will not be triggered until provisioned by entity L2. {{(pid=102323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:21:54.802405 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:54.818429 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50fb256f-bed7-4ae5-9cfd-71bd7cfba70c req-486e908f-b552-4294-9874-82f1d378ca44 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:54.820072 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-50fb256f-bed7-4ae5-9cfd-71bd7cfba70c req-486e908f-b552-4294-9874-82f1d378ca44 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 932 time: 0.0604067 Nov 11 17:21:54.884960 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Pushing event updated for resources: {'Port': ['ID=18cd1277-d6d0-48b5-bbbc-c0b112fe275f,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:54.950861 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-50fb256f-bed7-4ae5-9cfd-71bd7cfba70c req-62628f41-6df2-42e8-bed9-3c125d767f31 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1120331 Nov 11 17:21:54.989269 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Attempting to bind port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:21:54.989704 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Attempting to bind port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:21:54.990173 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Attempting to bind port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f on network 45e6626a-2007-490b-a445-d7c3baea689e {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:21:54.995176 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f on network 45e6626a-2007-490b-a445-d7c3baea689e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:21:54.995635 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Attempting to bind port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f on network 45e6626a-2007-490b-a445-d7c3baea689e {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:21:55.001310 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 21, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:21:55.001839 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Checking segment: {'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:21:55.002319 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Bound using segment: {'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:21:55.002891 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Bound port: 18cd1277-d6d0-48b5-bbbc-c0b112fe275f, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8ac7fd42-d3df-4810-add0-6e5903972d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e'}}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:21:55.003347 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:55.010072 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7d1fc88d-9527-4c9c-bd07-96191f8ba4d5 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:55.069309 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7d1fc88d-9527-4c9c-bd07-96191f8ba4d5 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:55.073110 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] For port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f, host hv-cinder-69414, cleared binding levels {{(pid=102323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:21:55.079314 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] For port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=18cd1277-d6d0-48b5-bbbc-c0b112fe275f,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:21:55.151167 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:55.187889 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.l3_db [None req-7d1fc88d-9527-4c9c-bd07-96191f8ba4d5 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Floating IP 4429514e-b44a-4fe9-8e2a-2b27d70a76f9 associated. External IP: 172.27.1.240, port: e641e657-04f2-4767-a7ef-934e2ccd7a0b. Nov 11 17:21:55.244688 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Pushing event updated for resources: {'Port': ['ID=18cd1277-d6d0-48b5-bbbc-c0b112fe275f,revision_number=3']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:21:55.259946 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:55.260950 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:55.263475 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-dd290c6d-82ff-455b-819e-9a644b969d3e service neutron] 10.222.0.10 "PUT /v2.0/ports/18cd1277-d6d0-48b5-bbbc-c0b112fe275f HTTP/1.1" status: 200 len: 1094 time: 0.9365845 Nov 11 17:21:55.264168 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7d756663-1f8a-4181-884f-ba0ae9a11772', 'tag': '18cd1277-d6d0-48b5-bbbc-c0b112fe275f'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:21:55.278478 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bf026f5f-1d1b-4979-ab06-de09f943bb3e" -d '{"events": [{"name": "network-changed", "server_uuid": "7d756663-1f8a-4181-884f-ba0ae9a11772", "tag": "18cd1277-d6d0-48b5-bbbc-c0b112fe275f"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:21:55.319610 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:21:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4d7398af-9b8d-426a-9c05-df29c0bcc453 x-openstack-request-id: req-4d7398af-9b8d-426a-9c05-df29c0bcc453 {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:21:55.320005 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7d756663-1f8a-4181-884f-ba0ae9a11772", "tag": "18cd1277-d6d0-48b5-bbbc-c0b112fe275f", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:21:55.320519 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-4d7398af-9b8d-426a-9c05-df29c0bcc453 {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:21:55.321062 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7d756663-1f8a-4181-884f-ba0ae9a11772', 'tag': '18cd1277-d6d0-48b5-bbbc-c0b112fe275f', 'status': 'completed', 'code': 200} Nov 11 17:21:55.398114 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf026f5f-1d1b-4979-ab06-de09f943bb3e req-4113f4ec-b942-4276-9067-17c84f7bd18e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:55.400280 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-bf026f5f-1d1b-4979-ab06-de09f943bb3e req-4113f4ec-b942-4276-9067-17c84f7bd18e service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 1097 time: 0.0500779 Nov 11 17:21:55.475319 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7d1fc88d-9527-4c9c-bd07-96191f8ba4d5 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Router 98cb701e-467a-4425-90db-9dbc5f732760 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:21:55.515138 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf026f5f-1d1b-4979-ab06-de09f943bb3e req-327ea5f1-a127-44e8-9720-37e32c02f772 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:55.517005 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-bf026f5f-1d1b-4979-ab06-de09f943bb3e req-327ea5f1-a127-44e8-9720-37e32c02f772 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=10bedfb35d1e481aa78e025489c1be2d&shared=False HTTP/1.1" status: 200 len: 912 time: 0.1073430 Nov 11 17:21:55.594345 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7d1fc88d-9527-4c9c-bd07-96191f8ba4d5 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:21:55.598763 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7d1fc88d-9527-4c9c-bd07-96191f8ba4d5 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:21:55.604575 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f91a9610-5d93-4d82-828b-82139834e35d None None] Sync routers for ids ['98cb701e-467a-4425-90db-9dbc5f732760'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:21:55.614420 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f91a9610-5d93-4d82-828b-82139834e35d None None] Routers {'98cb701e-467a-4425-90db-9dbc5f732760'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:21:55.615056 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-f91a9610-5d93-4d82-828b-82139834e35d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:21:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['98cb701e-467a-4425-90db-9dbc5f732760'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:55.623743 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf026f5f-1d1b-4979-ab06-de09f943bb3e req-a785abdc-23ae-41fc-9c0b-751d201d05d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:55.625238 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-bf026f5f-1d1b-4979-ab06-de09f943bb3e req-a785abdc-23ae-41fc-9c0b-751d201d05d4 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1009243 Nov 11 17:21:55.626053 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-7d1fc88d-9527-4c9c-bd07-96191f8ba4d5 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "PUT /v2.0/floatingips/4429514e-b44a-4fe9-8e2a-2b27d70a76f9 HTTP/1.1" status: 200 len: 991 time: 1.1733115 Nov 11 17:21:55.627308 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7d89b9bb-0141-4476-b119-26030b8f1e11', 'tag': 'e641e657-04f2-4767-a7ef-934e2ccd7a0b'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:21:55.629912 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a1cedc1d-e16b-489b-8a2f-3c8c48f92634" -d '{"events": [{"name": "network-changed", "server_uuid": "7d89b9bb-0141-4476-b119-26030b8f1e11", "tag": "e641e657-04f2-4767-a7ef-934e2ccd7a0b"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:21:55.671880 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:21:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ae5caaf9-1bdf-4444-9fff-da538a689099 x-openstack-request-id: req-ae5caaf9-1bdf-4444-9fff-da538a689099 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:21:55.672203 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7d89b9bb-0141-4476-b119-26030b8f1e11", "tag": "e641e657-04f2-4767-a7ef-934e2ccd7a0b", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:21:55.672460 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-ae5caaf9-1bdf-4444-9fff-da538a689099 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:21:55.672864 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7d89b9bb-0141-4476-b119-26030b8f1e11', 'tag': 'e641e657-04f2-4767-a7ef-934e2ccd7a0b', 'status': 'completed', 'code': 200} Nov 11 17:21:55.728387 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-fec8f3d0-c5dc-489d-b4c1-ba45c4ccb07f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:55.730132 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-fec8f3d0-c5dc-489d-b4c1-ba45c4ccb07f service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 1097 time: 0.0464144 Nov 11 17:21:55.733719 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-f91a9610-5d93-4d82-828b-82139834e35d None None] Set router 98cb701e-467a-4425-90db-9dbc5f732760 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:21:55.756704 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1cedc1d-e16b-489b-8a2f-3c8c48f92634 req-77689580-bf84-44c3-845d-7e9140344365 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:55.758330 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a1cedc1d-e16b-489b-8a2f-3c8c48f92634 req-77689580-bf84-44c3-845d-7e9140344365 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=7e951c2eae284261a98b317ec84140db&device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 1098 time: 0.0496931 Nov 11 17:21:55.777401 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-9f9d365d-bd0a-464a-b85b-1c08a1f2361f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=18cd1277-d6d0-48b5-bbbc-c0b112fe275f HTTP/1.1" status: 200 len: 217 time: 0.0395198 Nov 11 17:21:55.830639 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-92ad102b-81cc-493a-b40a-631771211966 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:55.832115 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-92ad102b-81cc-493a-b40a-631771211966 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=bf78c82f-f2f3-4ef7-8052-be816dbd2df8 HTTP/1.1" status: 200 len: 850 time: 0.0478194 Nov 11 17:21:55.859597 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1cedc1d-e16b-489b-8a2f-3c8c48f92634 req-43377088-4c5b-49c1-8094-528fd681f06f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:55.861609 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a1cedc1d-e16b-489b-8a2f-3c8c48f92634 req-43377088-4c5b-49c1-8094-528fd681f06f service neutron] 10.222.0.10 "GET /v2.0/networks?id=10ac93d3-f14d-4df5-a044-d683e35c1ab8 HTTP/1.1" status: 200 len: 912 time: 0.0960791 Nov 11 17:21:55.882421 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-3568861a-b4b8-4865-b2e8-cc882462a831 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:55.884002 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-3568861a-b4b8-4865-b2e8-cc882462a831 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=45e6626a-2007-490b-a445-d7c3baea689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0447984 Nov 11 17:21:55.942791 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a1cedc1d-e16b-489b-8a2f-3c8c48f92634 req-d83f133c-fa23-4f0e-b715-bfe010f41199 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e641e657-04f2-4767-a7ef-934e2ccd7a0b HTTP/1.1" status: 200 len: 999 time: 0.0742753 Nov 11 17:21:55.981602 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-f91a9610-5d93-4d82-828b-82139834e35d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '4429514e-b44a-4fe9-8e2a-2b27d70a76f9', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'floating_ip_address': '172.27.1.240', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'port_id': 'e641e657-04f2-4767-a7ef-934e2ccd7a0b', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'mac_address': 'fa:16:3e:b8:90:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d89b9bb-0141-4476-b119-26030b8f1e11', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:21:34Z', 'updated_at': '2021-11-11T17:21:54Z', 'revision_number': 1, 'project_id': '7e951c2eae284261a98b317ec84140db', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a', 'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'mac_address': 'fa:16:3e:04:45:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:18:01Z', 'updated_at': '2021-11-11T17:18:07Z', 'revision_number': 5, 'project_id': '7e951c2eae284261a98b317ec84140db', 'subnets': [{'id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:55.990949 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-4a74cb87-8edd-4641-92d2-178d557bd0f7 service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0996957 Nov 11 17:21:56.007980 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1cedc1d-e16b-489b-8a2f-3c8c48f92634 req-cb17ceec-0709-4078-a4b2-3b8b89aea651 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:56.010477 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a1cedc1d-e16b-489b-8a2f-3c8c48f92634 req-cb17ceec-0709-4078-a4b2-3b8b89aea651 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba HTTP/1.1" status: 200 len: 850 time: 0.0609090 Nov 11 17:21:56.012463 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f91a9610-5d93-4d82-828b-82139834e35d None None] Checking router: 98cb701e-467a-4425-90db-9dbc5f732760 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:21:56.021836 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f91a9610-5d93-4d82-828b-82139834e35d None None] Routers {'98cb701e-467a-4425-90db-9dbc5f732760'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:21:56.022437 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-f91a9610-5d93-4d82-828b-82139834e35d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:21:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['98cb701e-467a-4425-90db-9dbc5f732760'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:56.091577 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8847135d-9abc-43c2-b0b0-a4c8019b7611 req-9f29a6a1-94eb-4a6e-bdb5-cb4851922e5f service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0929382 Nov 11 17:21:56.094634 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1cedc1d-e16b-489b-8a2f-3c8c48f92634 req-b8ba5c12-77f2-498c-9b72-5f675add64b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:56.096612 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a1cedc1d-e16b-489b-8a2f-3c8c48f92634 req-b8ba5c12-77f2-498c-9b72-5f675add64b5 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=10ac93d3-f14d-4df5-a044-d683e35c1ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0788698 Nov 11 17:21:56.105343 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23cb29bf-3e38-486a-a369-db4ca7799dfb req-0d128ffc-e678-48c2-a34b-ef0ea2460681 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:56.106974 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-23cb29bf-3e38-486a-a369-db4ca7799dfb req-0d128ffc-e678-48c2-a34b-ef0ea2460681 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 944 time: 0.0763540 Nov 11 17:21:56.136031 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-f91a9610-5d93-4d82-828b-82139834e35d None None] Set router 98cb701e-467a-4425-90db-9dbc5f732760 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:21:56.216490 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-23cb29bf-3e38-486a-a369-db4ca7799dfb req-218effaf-aecd-4a3d-9e6d-37ffd7c7da35 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0995355 Nov 11 17:21:56.239993 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a1cedc1d-e16b-489b-8a2f-3c8c48f92634 req-f9db41c5-bf26-40db-9ce0-2952d5f3d941 service neutron] 10.222.0.10 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1313000 Nov 11 17:21:56.334888 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a1cedc1d-e16b-489b-8a2f-3c8c48f92634 req-c47c5747-24ed-4287-8b6d-e4214fe4e136 service neutron] 10.222.0.10 "GET /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871727 Nov 11 17:21:56.407312 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-f91a9610-5d93-4d82-828b-82139834e35d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '4429514e-b44a-4fe9-8e2a-2b27d70a76f9', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'floating_ip_address': '172.27.1.240', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'port_id': 'e641e657-04f2-4767-a7ef-934e2ccd7a0b', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'mac_address': 'fa:16:3e:b8:90:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d89b9bb-0141-4476-b119-26030b8f1e11', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:21:34Z', 'updated_at': '2021-11-11T17:21:54Z', 'revision_number': 1, 'project_id': '7e951c2eae284261a98b317ec84140db', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a', 'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'mac_address': 'fa:16:3e:04:45:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:18:01Z', 'updated_at': '2021-11-11T17:18:07Z', 'revision_number': 5, 'project_id': '7e951c2eae284261a98b317ec84140db', 'subnets': [{'id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:21:56.435303 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f91a9610-5d93-4d82-828b-82139834e35d None None] The sync data for ids ['98cb701e-467a-4425-90db-9dbc5f732760'] in dv-cinder-694140-2-iscsi is: [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '4429514e-b44a-4fe9-8e2a-2b27d70a76f9', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'floating_ip_address': '172.27.1.240', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'port_id': 'e641e657-04f2-4767-a7ef-934e2ccd7a0b', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'mac_address': 'fa:16:3e:b8:90:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d89b9bb-0141-4476-b119-26030b8f1e11', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:21:34Z', 'updated_at': '2021-11-11T17:21:54Z', 'revision_number': 1, 'project_id': '7e951c2eae284261a98b317ec84140db', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a', 'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'mac_address': 'fa:16:3e:04:45:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:18:01Z', 'updated_at': '2021-11-11T17:18:07Z', 'revision_number': 5, 'project_id': '7e951c2eae284261a98b317ec84140db', 'subnets': [{'id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:21:56.625998 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35215183-c165-4c7c-a7cc-b05313b892a1 None None] New status for floating IP 4429514e-b44a-4fe9-8e2a-2b27d70a76f9: ACTIVE {{(pid=102325) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:21:57.344899 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfca844c-fa01-4996-b30c-629dc3b53b7b req-6e6554e9-0304-4fd7-865a-e7f4c06e7095 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:57.346465 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dfca844c-fa01-4996-b30c-629dc3b53b7b req-6e6554e9-0304-4fd7-865a-e7f4c06e7095 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 944 time: 0.0533066 Nov 11 17:21:57.397061 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dfca844c-fa01-4996-b30c-629dc3b53b7b req-0a162065-c34c-43ee-b14a-e527d5e5bc6f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445991 Nov 11 17:21:58.510366 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8aac6ad-c14d-4e9a-a5e8-0bce6bdda12d req-ec0a55c3-909a-4920-9113-89e53959a520 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:58.511839 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d8aac6ad-c14d-4e9a-a5e8-0bce6bdda12d req-ec0a55c3-909a-4920-9113-89e53959a520 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 944 time: 0.0481925 Nov 11 17:21:58.560397 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d8aac6ad-c14d-4e9a-a5e8-0bce6bdda12d req-f6ae6d23-f0dd-48bf-97dc-c0a07cb2d51f tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419850 Nov 11 17:21:59.677121 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4987d4ed-e088-46fe-8a1c-80f670757dfd req-506354b5-a379-447d-b605-eebddb14641e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:21:59.678599 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4987d4ed-e088-46fe-8a1c-80f670757dfd req-506354b5-a379-447d-b605-eebddb14641e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 944 time: 0.0517509 Nov 11 17:21:59.733156 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4987d4ed-e088-46fe-8a1c-80f670757dfd req-9603a3e2-b19e-4962-8aeb-3eb41df9c46a tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484989 Nov 11 17:22:00.853018 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6b3b705-855c-43f3-a272-adea245affd7 req-25e9126b-8ab4-4903-bd7f-8d75da0b0346 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:00.854614 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b6b3b705-855c-43f3-a272-adea245affd7 req-25e9126b-8ab4-4903-bd7f-8d75da0b0346 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 944 time: 0.0509191 Nov 11 17:22:00.908721 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b6b3b705-855c-43f3-a272-adea245affd7 req-a72b0de4-71c5-4e47-8eb4-7e3850e64cec tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476928 Nov 11 17:22:00.937761 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-92785f15-b741-4b8d-8469-897d47d3024c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:02.024520 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fe76af2-73c3-4b0a-bba0-3781aa179a45 req-72418532-8176-465a-9592-91f928683ba9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:02.026785 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3fe76af2-73c3-4b0a-bba0-3781aa179a45 req-72418532-8176-465a-9592-91f928683ba9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 944 time: 0.0494020 Nov 11 17:22:02.081174 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3fe76af2-73c3-4b0a-bba0-3781aa179a45 req-d1e57729-4a41-4570-a558-5b905b9133f9 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460298 Nov 11 17:22:03.132078 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:22:03.196247 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ae6917b-902b-40a7-b9a0-618d5823c984 req-c8124fd5-b363-4827-9920-2cc86393cf31 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:03.197718 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8ae6917b-902b-40a7-b9a0-618d5823c984 req-c8124fd5-b363-4827-9920-2cc86393cf31 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 944 time: 0.0529983 Nov 11 17:22:03.247637 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8ae6917b-902b-40a7-b9a0-618d5823c984 req-5a8658ec-2e0d-40fe-9440-422ddd7c7438 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439808 Nov 11 17:22:03.531439 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-56197577-b938-4947-8038-50e448c92a3a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:04.031377 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 35652) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:22:04.132321 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f5dea406-2104-4118-9053-4c1b1a9b6445 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:04.203168 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f5dea406-2104-4118-9053-4c1b1a9b6445 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:04.239872 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f5dea406-2104-4118-9053-4c1b1a9b6445 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:04.291288 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-f5dea406-2104-4118-9053-4c1b1a9b6445 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=0374b08818314b12966b41af2bf47650&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2588067 Nov 11 17:22:04.292145 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5dea406-2104-4118-9053-4c1b1a9b6445 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=63220f2c-1401-4604-b41d-56f4ff7b1f0e,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:04.294041 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 35658) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:22:04.355646 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a6d73809-8b9d-4902-952b-bb2da5eb8421 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:04.374404 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a3a712-4bad-41aa-8185-462ee60a89d2 req-c2552fe2-79b7-4e05-a112-79e71f4d13fb tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:04.376148 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-17a3a712-4bad-41aa-8185-462ee60a89d2 req-c2552fe2-79b7-4e05-a112-79e71f4d13fb tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 944 time: 0.0515330 Nov 11 17:22:04.383459 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a6d73809-8b9d-4902-952b-bb2da5eb8421 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:04.429843 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-17a3a712-4bad-41aa-8185-462ee60a89d2 req-6d6b769b-74e3-4813-ae22-a7e0b88e5baa tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479226 Nov 11 17:22:04.475065 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a6d73809-8b9d-4902-952b-bb2da5eb8421 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:04.477669 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a6d73809-8b9d-4902-952b-bb2da5eb8421 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:04.478728 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-a6d73809-8b9d-4902-952b-bb2da5eb8421 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/63220f2c-1401-4604-b41d-56f4ff7b1f0e HTTP/1.1" status: 204 len: 168 time: 0.1830990 Nov 11 17:22:04.486730 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6d73809-8b9d-4902-952b-bb2da5eb8421 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=63220f2c-1401-4604-b41d-56f4ff7b1f0e,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:04.605923 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:05.178780 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 35666) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:22:05.191890 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c79193c2-995d-4ea6-a893-28bc01e5afe9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:05.268382 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c79193c2-995d-4ea6-a893-28bc01e5afe9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:05.331362 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c79193c2-995d-4ea6-a893-28bc01e5afe9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:05.370790 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-c79193c2-995d-4ea6-a893-28bc01e5afe9 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=d7fa2029ff0f4662aaace8d7eeb3d95c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1907985 Nov 11 17:22:05.373532 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c79193c2-995d-4ea6-a893-28bc01e5afe9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1bc02545-1c01-4bf5-a730-b553545f05a8,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:05.373774 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 35668) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:22:05.421829 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 18cd1277-d6d0-48b5-bbbc-c0b112fe275f details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:22:05.434997 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-13b16926-e677-460a-b2ad-f65b77f0a6d7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:05.469501 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-13b16926-e677-460a-b2ad-f65b77f0a6d7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:05.577020 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=18cd1277-d6d0-48b5-bbbc-c0b112fe275f,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:22:05.578196 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e086c3a8-a1f2-4de4-95eb-d017d681de26 req-d964a67f-c910-459d-86e1-efb20ed1d24e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:05.579709 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e086c3a8-a1f2-4de4-95eb-d017d681de26 req-d964a67f-c910-459d-86e1-efb20ed1d24e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 944 time: 0.0533669 Nov 11 17:22:05.589841 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '18cd1277-d6d0-48b5-bbbc-c0b112fe275f', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'port_id': '18cd1277-d6d0-48b5-bbbc-c0b112fe275f', 'mac_address': 'fa:16:3e:7d:16:97', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 505, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:22:05.601143 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-13b16926-e677-460a-b2ad-f65b77f0a6d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:05.603710 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-13b16926-e677-460a-b2ad-f65b77f0a6d7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:05.604845 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-13b16926-e677-460a-b2ad-f65b77f0a6d7 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/1bc02545-1c01-4bf5-a730-b553545f05a8 HTTP/1.1" status: 204 len: 168 time: 0.2302053 Nov 11 17:22:05.620975 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13b16926-e677-460a-b2ad-f65b77f0a6d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1bc02545-1c01-4bf5-a730-b553545f05a8,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:05.659778 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e086c3a8-a1f2-4de4-95eb-d017d681de26 req-db7ad42c-d507-4e9a-87c1-05992b09238c tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0725553 Nov 11 17:22:05.768039 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:05.782583 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 18cd1277-d6d0-48b5-bbbc-c0b112fe275f {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:22:05.802019 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=18cd1277-d6d0-48b5-bbbc-c0b112fe275f,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:22:05.863019 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:05.913815 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=18cd1277-d6d0-48b5-bbbc-c0b112fe275f,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:06.106783 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['18cd1277-d6d0-48b5-bbbc-c0b112fe275f'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:22:06.359909 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:06.778590 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10701605-1d96-4869-86bd-86289a145370 req-f5e212e9-0e79-4c5c-9373-6e83d72cdc5b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:06.780024 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-10701605-1d96-4869-86bd-86289a145370 req-f5e212e9-0e79-4c5c-9373-6e83d72cdc5b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 945 time: 0.0508935 Nov 11 17:22:06.829681 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-10701605-1d96-4869-86bd-86289a145370 req-fc9b0eb2-064f-4050-8368-706ac5f779d3 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431416 Nov 11 17:22:06.983099 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:07.435920 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 18cd1277-d6d0-48b5-bbbc-c0b112fe275f up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:22:07.547910 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:22:07.552514 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:22:07.552878 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:07.629072 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:07.653231 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7d756663-1f8a-4181-884f-ba0ae9a11772', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '18cd1277-d6d0-48b5-bbbc-c0b112fe275f'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:22:07.655597 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7cac79d4-3f7b-45a7-85d3-b96f62490557" -d '{"events": [{"server_uuid": "7d756663-1f8a-4181-884f-ba0ae9a11772", "name": "network-vif-plugged", "status": "completed", "tag": "18cd1277-d6d0-48b5-bbbc-c0b112fe275f"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:22:07.670119 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=18cd1277-d6d0-48b5-bbbc-c0b112fe275f,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:22:07.707299 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:22:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-18772659-563a-4073-a3bf-d62451d84a67 x-openstack-request-id: req-18772659-563a-4073-a3bf-d62451d84a67 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:22:07.707826 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7d756663-1f8a-4181-884f-ba0ae9a11772", "name": "network-vif-plugged", "status": "completed", "tag": "18cd1277-d6d0-48b5-bbbc-c0b112fe275f", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:22:07.708078 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-18772659-563a-4073-a3bf-d62451d84a67 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:22:07.708471 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7d756663-1f8a-4181-884f-ba0ae9a11772', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '18cd1277-d6d0-48b5-bbbc-c0b112fe275f', 'code': 200} Nov 11 17:22:07.737762 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:07.791623 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=18cd1277-d6d0-48b5-bbbc-c0b112fe275f,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:07.948657 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8b3c304-e951-4134-b64c-5108cc927cbc req-6c575bd7-922a-4b15-a0cc-2533d1fdbaa3 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:07.950220 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c8b3c304-e951-4134-b64c-5108cc927cbc req-6c575bd7-922a-4b15-a0cc-2533d1fdbaa3 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 946 time: 0.0510535 Nov 11 17:22:08.001769 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c8b3c304-e951-4134-b64c-5108cc927cbc req-70bc8755-574b-42c0-9e72-676a6b93746b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449696 Nov 11 17:22:08.126570 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9c8dc3-498d-4fe6-b4af-94f32736c7f5 req-c8cff720-e03c-42d3-928c-e28b06988a19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:08.128590 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7f9c8dc3-498d-4fe6-b4af-94f32736c7f5 req-c8cff720-e03c-42d3-928c-e28b06988a19 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 1099 time: 0.0446713 Nov 11 17:22:08.173939 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7f9c8dc3-498d-4fe6-b4af-94f32736c7f5 req-fe601260-6308-4b82-9021-4b58baf6d7d3 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386400 Nov 11 17:22:09.127198 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4cfd336-30ab-435a-a5e8-ad5c50d80394 req-505cd56d-cf39-4562-bc58-d7702d9e8c42 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:09.128785 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a4cfd336-30ab-435a-a5e8-ad5c50d80394 req-505cd56d-cf39-4562-bc58-d7702d9e8c42 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 946 time: 0.0487831 Nov 11 17:22:09.179079 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a4cfd336-30ab-435a-a5e8-ad5c50d80394 req-7320d374-bbe9-44d2-a941-e116fce76031 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438881 Nov 11 17:22:10.291918 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed38dab7-4cc5-48f3-85be-e85083497f4a req-829d4289-cc0c-4fc0-84df-d73fcf6f7284 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:10.293367 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ed38dab7-4cc5-48f3-85be-e85083497f4a req-829d4289-cc0c-4fc0-84df-d73fcf6f7284 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 946 time: 0.0485840 Nov 11 17:22:10.345476 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ed38dab7-4cc5-48f3-85be-e85083497f4a req-d4e11620-4f48-470b-bb76-ec784d2a0d1e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462067 Nov 11 17:22:10.462291 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6da59659-dffb-43ce-836e-415b095f41f4 req-8d61f176-d016-4f34-9023-46c72c95384c tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:10.464095 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6da59659-dffb-43ce-836e-415b095f41f4 req-8d61f176-d016-4f34-9023-46c72c95384c tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 946 time: 0.0487556 Nov 11 17:22:10.518330 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6da59659-dffb-43ce-836e-415b095f41f4 req-5ba62ca5-5d5d-4b84-a9a7-c579f003f433 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483432 Nov 11 17:22:10.541011 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 35756) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:22:10.579772 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3472c4d2-6ba7-4f4c-b53e-d49a92d5c13c tempest-TestVolumeBootPattern-934397991 tempest-TestVolumeBootPattern-934397991-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:10.581286 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-3472c4d2-6ba7-4f4c-b53e-d49a92d5c13c tempest-TestVolumeBootPattern-934397991 tempest-TestVolumeBootPattern-934397991-project-admin] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 1094 time: 0.0392637 Nov 11 17:22:10.584698 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 35758) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:22:10.589298 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Request body: {'floatingip': {'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'port_id': '18cd1277-d6d0-48b5-bbbc-c0b112fe275f', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address': '172.20.0.13'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:22:10.668736 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for floatingip, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:10.760835 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:11.118807 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Allocated IP 172.27.1.228 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/8e1eef75-6ce5-43d5-a1e3-462135870861) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:22:11.216044 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:11.280352 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:11.319331 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:22:11.322117 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:22:11.325600 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:22:11.330998 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event updated for resources: {'Port': ['ID=8e1eef75-6ce5-43d5-a1e3-462135870861,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:11.684186 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:11.806987 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:11.956459 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:12.005424 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:12.073374 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event updated for resources: {'Port': ['ID=8e1eef75-6ce5-43d5-a1e3-462135870861,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:12.084887 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:12.194123 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.l3_db [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Floating IP 143f1b78-c826-4036-b24a-434913f42ef9 associated. External IP: 172.27.1.228, port: 18cd1277-d6d0-48b5-bbbc-c0b112fe275f. Nov 11 17:22:12.407865 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Router 1267b92b-e259-4df2-9704-b862470a9e03 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:22:12.516106 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:22:12.525916 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-459eea54-ebe2-4a5c-b992-0627a25dcacd None None] Sync routers for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:22:12.535183 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-459eea54-ebe2-4a5c-b992-0627a25dcacd None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:22:12.535889 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-459eea54-ebe2-4a5c-b992-0627a25dcacd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:22:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:22:12.590632 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:12.618686 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-65d5889f-9388-497b-8914-f0a8f1c655ab tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.0328588 Nov 11 17:22:12.619289 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7d756663-1f8a-4181-884f-ba0ae9a11772', 'tag': '18cd1277-d6d0-48b5-bbbc-c0b112fe275f'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:22:12.621526 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cb2e313d-1ba6-4ec8-9103-1ade779ff085" -d '{"events": [{"name": "network-changed", "server_uuid": "7d756663-1f8a-4181-884f-ba0ae9a11772", "tag": "18cd1277-d6d0-48b5-bbbc-c0b112fe275f"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:22:12.645397 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-459eea54-ebe2-4a5c-b992-0627a25dcacd None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:22:12.667016 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:22:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-967120be-37f6-4403-96e7-3675358e7141 x-openstack-request-id: req-967120be-37f6-4403-96e7-3675358e7141 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:22:12.667340 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7d756663-1f8a-4181-884f-ba0ae9a11772", "tag": "18cd1277-d6d0-48b5-bbbc-c0b112fe275f", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:22:12.667540 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-967120be-37f6-4403-96e7-3675358e7141 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:22:12.667934 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7d756663-1f8a-4181-884f-ba0ae9a11772', 'tag': '18cd1277-d6d0-48b5-bbbc-c0b112fe275f', 'status': 'completed', 'code': 200} Nov 11 17:22:12.734828 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb2e313d-1ba6-4ec8-9103-1ade779ff085 req-55692199-3e58-4223-adac-548acf9479f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:12.736474 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cb2e313d-1ba6-4ec8-9103-1ade779ff085 req-55692199-3e58-4223-adac-548acf9479f7 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 1099 time: 0.0465078 Nov 11 17:22:12.767052 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 35778) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:22:12.843525 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb2e313d-1ba6-4ec8-9103-1ade779ff085 req-cefb4d02-8f7b-484f-a313-8c7d23322528 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:12.845012 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cb2e313d-1ba6-4ec8-9103-1ade779ff085 req-cefb4d02-8f7b-484f-a313-8c7d23322528 service neutron] 10.222.0.10 "GET /v2.0/networks?id=45e6626a-2007-490b-a445-d7c3baea689e HTTP/1.1" status: 200 len: 912 time: 0.0998552 Nov 11 17:22:12.877497 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-22d1ff13-275a-4532-b489-bf48fba47e2e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:12.915418 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cb2e313d-1ba6-4ec8-9103-1ade779ff085 req-40e72881-aa82-480b-b912-a2e6608ca89a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=18cd1277-d6d0-48b5-bbbc-c0b112fe275f HTTP/1.1" status: 200 len: 1000 time: 0.0623298 Nov 11 17:22:12.965567 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-22d1ff13-275a-4532-b489-bf48fba47e2e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:12.978298 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb2e313d-1ba6-4ec8-9103-1ade779ff085 req-b29314a9-8add-4ea3-97e1-e31496b7db13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:12.979923 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cb2e313d-1ba6-4ec8-9103-1ade779ff085 req-b29314a9-8add-4ea3-97e1-e31496b7db13 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=bf78c82f-f2f3-4ef7-8052-be816dbd2df8 HTTP/1.1" status: 200 len: 850 time: 0.0569942 Nov 11 17:22:12.985026 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-459eea54-ebe2-4a5c-b992-0627a25dcacd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '143f1b78-c826-4036-b24a-434913f42ef9', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'floating_ip_address': '172.27.1.228', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'port_id': '18cd1277-d6d0-48b5-bbbc-c0b112fe275f', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'mac_address': 'fa:16:3e:7d:16:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d756663-1f8a-4181-884f-ba0ae9a11772', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:22:11Z', 'updated_at': '2021-11-11T17:22:11Z', 'revision_number': 0, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address_scope': None}, {'id': '98da0cbf-ec1c-4c72-a17d-c2c96671021e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'floating_ip_address': '172.27.1.133', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'port_id': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 542, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'mac_address': 'fa:16:3e:b6:db:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:20:09Z', 'updated_at': '2021-11-11T17:20:12Z', 'revision_number': 1, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:22:13.011642 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-459eea54-ebe2-4a5c-b992-0627a25dcacd None None] Checking router: 1267b92b-e259-4df2-9704-b862470a9e03 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:22:13.016523 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-22d1ff13-275a-4532-b489-bf48fba47e2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:13.020471 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-459eea54-ebe2-4a5c-b992-0627a25dcacd None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:22:13.021595 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-459eea54-ebe2-4a5c-b992-0627a25dcacd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:22:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:22:13.031603 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb2e313d-1ba6-4ec8-9103-1ade779ff085 req-c2871916-7f9c-466c-8682-a0268bee74b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:13.033147 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cb2e313d-1ba6-4ec8-9103-1ade779ff085 req-c2871916-7f9c-466c-8682-a0268bee74b7 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=45e6626a-2007-490b-a445-d7c3baea689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0434039 Nov 11 17:22:13.057320 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-22d1ff13-275a-4532-b489-bf48fba47e2e admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=a325b3cbf24144ee85aa58b7db1091d5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2890522 Nov 11 17:22:13.058424 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22d1ff13-275a-4532-b489-bf48fba47e2e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40bf7ed1-14c8-400b-bd4d-a00a62b89313,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:13.061032 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 35782) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:22:13.117265 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b94db653-b33a-4067-8563-12d6268fb245 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:13.137725 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cb2e313d-1ba6-4ec8-9103-1ade779ff085 req-c6ce5c65-4c10-4a7c-9952-2ff91382d8c9 service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0943320 Nov 11 17:22:13.139726 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b94db653-b33a-4067-8563-12d6268fb245 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:13.140349 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-459eea54-ebe2-4a5c-b992-0627a25dcacd None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:22:13.241902 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-cb2e313d-1ba6-4ec8-9103-1ade779ff085 req-05d2343f-e94a-4f81-8903-1b39ec16f7a8 service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0964687 Nov 11 17:22:13.274159 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b94db653-b33a-4067-8563-12d6268fb245 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:13.276933 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b94db653-b33a-4067-8563-12d6268fb245 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:13.278458 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-b94db653-b33a-4067-8563-12d6268fb245 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/40bf7ed1-14c8-400b-bd4d-a00a62b89313 HTTP/1.1" status: 204 len: 168 time: 0.2161355 Nov 11 17:22:13.290208 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b94db653-b33a-4067-8563-12d6268fb245 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40bf7ed1-14c8-400b-bd4d-a00a62b89313,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:13.389710 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-459eea54-ebe2-4a5c-b992-0627a25dcacd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '143f1b78-c826-4036-b24a-434913f42ef9', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'floating_ip_address': '172.27.1.228', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'port_id': '18cd1277-d6d0-48b5-bbbc-c0b112fe275f', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'mac_address': 'fa:16:3e:7d:16:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d756663-1f8a-4181-884f-ba0ae9a11772', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:22:11Z', 'updated_at': '2021-11-11T17:22:11Z', 'revision_number': 0, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address_scope': None}, {'id': '98da0cbf-ec1c-4c72-a17d-c2c96671021e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'floating_ip_address': '172.27.1.133', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'port_id': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 542, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'mac_address': 'fa:16:3e:b6:db:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:20:09Z', 'updated_at': '2021-11-11T17:20:12Z', 'revision_number': 1, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:22:13.420323 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-459eea54-ebe2-4a5c-b992-0627a25dcacd None None] The sync data for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi is: [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '143f1b78-c826-4036-b24a-434913f42ef9', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'floating_ip_address': '172.27.1.228', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'port_id': '18cd1277-d6d0-48b5-bbbc-c0b112fe275f', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'mac_address': 'fa:16:3e:7d:16:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d756663-1f8a-4181-884f-ba0ae9a11772', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:22:11Z', 'updated_at': '2021-11-11T17:22:11Z', 'revision_number': 0, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address_scope': None}, {'id': '98da0cbf-ec1c-4c72-a17d-c2c96671021e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'floating_ip_address': '172.27.1.133', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'port_id': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 542, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'mac_address': 'fa:16:3e:b6:db:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:20:09Z', 'updated_at': '2021-11-11T17:20:12Z', 'revision_number': 1, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:22:13.633796 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32cbe17f-c818-4a31-b8b8-00e12b73c49e None None] New status for floating IP 143f1b78-c826-4036-b24a-434913f42ef9: ACTIVE {{(pid=102325) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:22:13.925122 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 35790) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:22:13.938620 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4d8bd667-49d7-4914-894f-d0d780524068 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:14.013911 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4d8bd667-49d7-4914-894f-d0d780524068 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:14.079484 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4d8bd667-49d7-4914-894f-d0d780524068 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:14.120450 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d8bd667-49d7-4914-894f-d0d780524068 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4de8773-e676-430d-ac1f-364e02e887be,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:14.124716 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-4d8bd667-49d7-4914-894f-d0d780524068 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=fe550b4674ce49408744e7cb5aea0b2a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1985426 Nov 11 17:22:14.128035 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 35792) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:22:14.176162 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-290a7f4e-9609-4d0d-9ad5-0e75381d83e8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:14.197058 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-290a7f4e-9609-4d0d-9ad5-0e75381d83e8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:14.313652 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-290a7f4e-9609-4d0d-9ad5-0e75381d83e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:14.316275 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-290a7f4e-9609-4d0d-9ad5-0e75381d83e8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:14.317414 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-290a7f4e-9609-4d0d-9ad5-0e75381d83e8 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/d4de8773-e676-430d-ac1f-364e02e887be HTTP/1.1" status: 204 len: 168 time: 0.1890225 Nov 11 17:22:14.325465 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-290a7f4e-9609-4d0d-9ad5-0e75381d83e8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4de8773-e676-430d-ac1f-364e02e887be,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:16.870031 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8445d8e2-ac16-4b57-bd41-c08b21f0d2c0 req-22618466-bd0b-4554-a623-6027d0cf1956 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0390198 Nov 11 17:22:16.879438 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:16.936158 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8445d8e2-ac16-4b57-bd41-c08b21f0d2c0 req-7b18ee9b-1784-4c34-8349-e3c71bb24b5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:16.937615 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8445d8e2-ac16-4b57-bd41-c08b21f0d2c0 req-7b18ee9b-1784-4c34-8349-e3c71bb24b5d service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 1098 time: 0.0435488 Nov 11 17:22:17.045432 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8445d8e2-ac16-4b57-bd41-c08b21f0d2c0 req-676375ce-cfdb-4396-8af7-959d92f6a483 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:17.047298 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8445d8e2-ac16-4b57-bd41-c08b21f0d2c0 req-676375ce-cfdb-4396-8af7-959d92f6a483 service neutron] 10.222.0.10 "GET /v2.0/networks?id=45e6626a-2007-490b-a445-d7c3baea689e HTTP/1.1" status: 200 len: 912 time: 0.0873041 Nov 11 17:22:17.115990 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8445d8e2-ac16-4b57-bd41-c08b21f0d2c0 req-722e3d09-0392-4e1a-9f23-e3ba3146ba01 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5d28ea1f-ba26-4f7e-93e2-89690070a29f HTTP/1.1" status: 200 len: 1001 time: 0.0614357 Nov 11 17:22:17.167639 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8445d8e2-ac16-4b57-bd41-c08b21f0d2c0 req-828c99ed-9a6b-4a4e-8613-8f778d7a064e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:17.169181 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8445d8e2-ac16-4b57-bd41-c08b21f0d2c0 req-828c99ed-9a6b-4a4e-8613-8f778d7a064e service neutron] 10.222.0.10 "GET /v2.0/subnets?id=bf78c82f-f2f3-4ef7-8052-be816dbd2df8 HTTP/1.1" status: 200 len: 850 time: 0.0440826 Nov 11 17:22:17.216614 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8445d8e2-ac16-4b57-bd41-c08b21f0d2c0 req-40a41f07-6adc-448c-8aa8-305ab43ee5ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:17.218080 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8445d8e2-ac16-4b57-bd41-c08b21f0d2c0 req-40a41f07-6adc-448c-8aa8-305ab43ee5ab service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=45e6626a-2007-490b-a445-d7c3baea689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0403368 Nov 11 17:22:17.318324 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8445d8e2-ac16-4b57-bd41-c08b21f0d2c0 req-844b7711-3570-4a1e-9d89-df3230bff355 service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0927441 Nov 11 17:22:17.424033 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8445d8e2-ac16-4b57-bd41-c08b21f0d2c0 req-b727ddf6-4a0a-4c95-a511-7855fdfcac84 service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0981526 Nov 11 17:22:30.941226 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-2cdbc455-022c-4aae-88e8-d5b709f2cc7b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:33.564012 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-60d2c4f7-8171-4fab-a9f8-6458f6abe648 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:34.587217 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:36.075662 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 35982) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:22:36.184430 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:36.260983 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:36.335387 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:36.358195 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:36.384279 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=eb1fd2dd9cca4aa4896d747e1a8b0b2f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3074999 Nov 11 17:22:36.386536 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14a88617-7b0d-4da9-a13e-2e1a43257815,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:36.389553 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 35988) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:22:36.401302 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:36.401655 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:36.403006 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:36.403426 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:36.403796 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:36.404106 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:36.404436 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:36.404768 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:36.405099 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:36.405426 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:36.405749 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:36.406082 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6461209d-3bc7-43bd-900f-81c056c3ce89 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:36.454699 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-68c3c0ca-c594-4ba8-85b5-5f98b4501433 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:36.477868 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-68c3c0ca-c594-4ba8-85b5-5f98b4501433 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:36.563699 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-68c3c0ca-c594-4ba8-85b5-5f98b4501433 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:36.566297 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-68c3c0ca-c594-4ba8-85b5-5f98b4501433 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:36.567475 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-68c3c0ca-c594-4ba8-85b5-5f98b4501433 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/14a88617-7b0d-4da9-a13e-2e1a43257815 HTTP/1.1" status: 204 len: 168 time: 0.1769838 Nov 11 17:22:36.577368 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68c3c0ca-c594-4ba8-85b5-5f98b4501433 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14a88617-7b0d-4da9-a13e-2e1a43257815,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:37.009903 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:37.457318 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36012) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:22:37.557593 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-183b348b-cf48-4079-9493-e1ccacff7833 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-13131651-network', 'tenant_id': 'cda486fa48ba43ef850a91d2cc5fca1d'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:22:37.632471 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-183b348b-cf48-4079-9493-e1ccacff7833 admin admin] Made reservation on behalf of cda486fa48ba43ef850a91d2cc5fca1d for: {'network': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:22:37.635551 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-183b348b-cf48-4079-9493-e1ccacff7833 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:37.644522 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-183b348b-cf48-4079-9493-e1ccacff7833 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:37.734571 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-183b348b-cf48-4079-9493-e1ccacff7833 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:37.803783 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-183b348b-cf48-4079-9493-e1ccacff7833 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:37.829003 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-183b348b-cf48-4079-9493-e1ccacff7833 admin admin] vlan segment allocate from pool success with {'vlan_id': 519, 'physical_network': 'physnet1'} {{(pid=102323) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:22:37.838663 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-183b348b-cf48-4079-9493-e1ccacff7833 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f54f1415-3005-4d30-9cbd-6a9342486bb3,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:37.844691 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-183b348b-cf48-4079-9493-e1ccacff7833 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:37.845034 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.segments_db [None req-183b348b-cf48-4079-9493-e1ccacff7833 admin admin] Added segment 753ecf25-f3e0-45e8-979a-6bf9fed6081c of type vlan for network 6ef38ec7-2801-48d8-a258-bd68f4aeffc2 Nov 11 17:22:37.887843 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-183b348b-cf48-4079-9493-e1ccacff7833 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:37.981209 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-183b348b-cf48-4079-9493-e1ccacff7833 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:37.982197 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-183b348b-cf48-4079-9493-e1ccacff7833 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:37.982933 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-183b348b-cf48-4079-9493-e1ccacff7833 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:38.062820 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-183b348b-cf48-4079-9493-e1ccacff7833 admin admin] Pushing event updated for resources: {'Network': ['ID=6ef38ec7-2801-48d8-a258-bd68f4aeffc2,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:38.074064 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network 6ef38ec7-2801-48d8-a258-bd68f4aeffc2 details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:22:38.092431 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-183b348b-cf48-4079-9493-e1ccacff7833 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 880 time: 0.6337886 Nov 11 17:22:38.095590 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 36022) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:22:38.106831 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Request body: {'subnet': {'network_id': '6ef38ec7-2801-48d8-a258-bd68f4aeffc2', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-13131651-subnet', 'tenant_id': 'cda486fa48ba43ef850a91d2cc5fca1d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:22:38.204372 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Made reservation on behalf of cda486fa48ba43ef850a91d2cc5fca1d for: {'subnet': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:22:38.207254 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5275488'] for subnet, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:38.496069 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5436401', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5275470'] for subnet, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:38.555882 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d68553ee-3443-497b-8d4d-d6a614d8ae12,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:38.567843 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:38.568203 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:38.569912 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:38.569912 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:38.569912 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:38.569912 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:38.569912 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:38.573151 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:38.573151 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:38.573151 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:38.573151 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:38.573151 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:38.575420 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Checking segment: {'id': '753ecf25-f3e0-45e8-979a-6bf9fed6081c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 519, 'network_id': '6ef38ec7-2801-48d8-a258-bd68f4aeffc2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:22:38.575824 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Network hostable DHCP agents. Network: 6ef38ec7-2801-48d8-a258-bd68f4aeffc2, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:22:38.661213 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Network 6ef38ec7-2801-48d8-a258-bd68f4aeffc2 is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:22:38.769624 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, 6ef38ec7-2801-48d8-a258-bd68f4aeffc2) {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:22:38.774116 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:38.776458 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:38.783649 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-73b01977-2f2a-44dc-a059-1487a2110d14 None None] Network 6ef38ec7-2801-48d8-a258-bd68f4aeffc2 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:22:38.873549 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-03e1302c-1b74-4f20-ae4a-3153640acfa6 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.7670779 Nov 11 17:22:38.906409 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-065fe1a9-5acc-49a4-b5af-cabbbc4da64f None None] Network 6ef38ec7-2801-48d8-a258-bd68f4aeffc2 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:22:40.131955 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:22:41.012355 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-2467595b-e89d-48b0-b42b-c92c87f95f34 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:41.013825 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-2467595b-e89d-48b0-b42b-c92c87f95f34 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/networks?id=6ef38ec7-2801-48d8-a258-bd68f4aeffc2 HTTP/1.1" status: 200 len: 807 time: 0.1002204 Nov 11 17:22:41.029018 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-43b8ba3a-1e0d-49f2-b758-7c5be12138da tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/quotas/cda486fa48ba43ef850a91d2cc5fca1d HTTP/1.1" status: 200 len: 375 time: 0.0093522 Nov 11 17:22:41.060795 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-fd01d2f9-7b57-4726-b159-143aaf3282a4 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=cda486fa48ba43ef850a91d2cc5fca1d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0262389 Nov 11 17:22:41.152207 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-0a9a0032-f562-465f-abd2-9439099d7e19 service neutron] 10.222.0.16 "GET /v2.0/networks/6ef38ec7-2801-48d8-a258-bd68f4aeffc2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844314 Nov 11 17:22:41.251635 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-22bc990a-5ff1-4ce1-ab4e-fbc15237a6b5 service neutron] 10.222.0.16 "GET /v2.0/networks/6ef38ec7-2801-48d8-a258-bd68f4aeffc2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0932791 Nov 11 17:22:41.515303 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d774a23b-e935-4510-b5f7-b75a4fa735a8 req-643e9544-d339-479a-a0dc-85e7c6232a96 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 210 time: 0.0267451 Nov 11 17:22:42.627809 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c06a622b-c7d0-4c79-abf7-610be0348ed4 req-2dc782cf-27be-419c-a352-b87b2e9ccfbf tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 210 time: 0.0325551 Nov 11 17:22:43.736696 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9808753c-8ff0-46f0-8d4b-1b1a0bcc63c7 req-8cbb527c-f2e7-48b5-8e27-5bf4d4a4470d tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 210 time: 0.0352516 Nov 11 17:22:43.968695 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d927d7c-5147-4b48-9804-89e3a1c4393e tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:43.970021 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d927d7c-5147-4b48-9804-89e3a1c4393e tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.10 "GET /v2.0/networks?id=6ef38ec7-2801-48d8-a258-bd68f4aeffc2 HTTP/1.1" status: 200 len: 807 time: 0.1049612 Nov 11 17:22:43.987267 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-fbf9b646-eb53-48c0-a449-bd6e6a76ee43 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Request body: {'port': {'device_id': '3c7a50de-b38e-4e96-bff2-4c4b37b8ade1', 'network_id': '6ef38ec7-2801-48d8-a258-bd68f4aeffc2', 'admin_state_up': True, 'tenant_id': 'cda486fa48ba43ef850a91d2cc5fca1d'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:22:44.146213 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-fbf9b646-eb53-48c0-a449-bd6e6a76ee43 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Made reservation on behalf of cda486fa48ba43ef850a91d2cc5fca1d for: {'port': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:22:44.149938 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-fbf9b646-eb53-48c0-a449-bd6e6a76ee43 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:44.276093 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-fbf9b646-eb53-48c0-a449-bd6e6a76ee43 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Allocated IP 172.20.0.3 (6ef38ec7-2801-48d8-a258-bd68f4aeffc2/d68553ee-3443-497b-8d4d-d6a614d8ae12/91db4a29-53e0-45cb-b84b-6d6d03bf4252) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:22:44.430593 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-fbf9b646-eb53-48c0-a449-bd6e6a76ee43 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:44.518251 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-fbf9b646-eb53-48c0-a449-bd6e6a76ee43 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:44.561015 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-fbf9b646-eb53-48c0-a449-bd6e6a76ee43 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Network 6ef38ec7-2801-48d8-a258-bd68f4aeffc2 is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:22:44.564013 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-fbf9b646-eb53-48c0-a449-bd6e6a76ee43 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:22:44.567604 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-fbf9b646-eb53-48c0-a449-bd6e6a76ee43 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:22:44.574649 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbf9b646-eb53-48c0-a449-bd6e6a76ee43 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Pushing event updated for resources: {'Port': ['ID=91db4a29-53e0-45cb-b84b-6d6d03bf4252,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:44.621995 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-fbf9b646-eb53-48c0-a449-bd6e6a76ee43 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:44.622616 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-fbf9b646-eb53-48c0-a449-bd6e6a76ee43 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:44.697295 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-fbf9b646-eb53-48c0-a449-bd6e6a76ee43 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7138028 Nov 11 17:22:44.713826 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Request body: {'port': {'device_id': '3c7a50de-b38e-4e96-bff2-4c4b37b8ade1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:22:44.765196 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:44.929452 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-662bc69a-6134-4f4e-867a-d946436f12af req-4fcdd134-290d-4e2d-b0f4-e5ed75c1817c tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:44.931524 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-662bc69a-6134-4f4e-867a-d946436f12af req-4fcdd134-290d-4e2d-b0f4-e5ed75c1817c tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 931 time: 0.1168277 Nov 11 17:22:45.020987 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-662bc69a-6134-4f4e-867a-d946436f12af req-40fa16c9-04a6-4231-8471-f6b0625d495a tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0832574 Nov 11 17:22:45.088444 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 91db4a29-53e0-45cb-b84b-6d6d03bf4252 {{(pid=102324) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:22:45.095773 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:45.108365 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.provisioning_blocks [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Transition to ACTIVE for port object 91db4a29-53e0-45cb-b84b-6d6d03bf4252 will not be triggered until provisioned by entity L2. {{(pid=102324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:22:45.186201 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:45.235443 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Pushing event updated for resources: {'Port': ['ID=91db4a29-53e0-45cb-b84b-6d6d03bf4252,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:45.305028 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Attempting to bind port 91db4a29-53e0-45cb-b84b-6d6d03bf4252 on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:22:45.305363 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Attempting to bind port 91db4a29-53e0-45cb-b84b-6d6d03bf4252 by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '753ecf25-f3e0-45e8-979a-6bf9fed6081c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 519, 'network_id': '6ef38ec7-2801-48d8-a258-bd68f4aeffc2'}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:22:45.305519 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Attempting to bind port 91db4a29-53e0-45cb-b84b-6d6d03bf4252 on network 6ef38ec7-2801-48d8-a258-bd68f4aeffc2 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:22:45.309742 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Port 91db4a29-53e0-45cb-b84b-6d6d03bf4252 on network 6ef38ec7-2801-48d8-a258-bd68f4aeffc2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:22:45.310057 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Attempting to bind port 91db4a29-53e0-45cb-b84b-6d6d03bf4252 on network 6ef38ec7-2801-48d8-a258-bd68f4aeffc2 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:22:45.314766 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 22, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:22:45.315098 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Checking segment: {'id': '753ecf25-f3e0-45e8-979a-6bf9fed6081c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 519, 'network_id': '6ef38ec7-2801-48d8-a258-bd68f4aeffc2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:22:45.315474 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Bound using segment: {'id': '753ecf25-f3e0-45e8-979a-6bf9fed6081c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 519, 'network_id': '6ef38ec7-2801-48d8-a258-bd68f4aeffc2'} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:22:45.315889 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Bound port: 91db4a29-53e0-45cb-b84b-6d6d03bf4252, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '753ecf25-f3e0-45e8-979a-6bf9fed6081c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 519, 'network_id': '6ef38ec7-2801-48d8-a258-bd68f4aeffc2'}}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:22:45.316237 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:45.387251 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] For port 91db4a29-53e0-45cb-b84b-6d6d03bf4252, host hv-cinder-69414, cleared binding levels {{(pid=102324) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:22:45.390917 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] For port 91db4a29-53e0-45cb-b84b-6d6d03bf4252, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=91db4a29-53e0-45cb-b84b-6d6d03bf4252,segment=NetworkSegment(753ecf25-f3e0-45e8-979a-6bf9fed6081c),segment_id=753ecf25-f3e0-45e8-979a-6bf9fed6081c)] {{(pid=102324) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:22:45.500964 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:45.539404 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:45.540025 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:45.541455 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] 10.222.0.10 "PUT /v2.0/ports/91db4a29-53e0-45cb-b84b-6d6d03bf4252 HTTP/1.1" status: 200 len: 1093 time: 0.8318150 Nov 11 17:22:45.541880 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3c7a50de-b38e-4e96-bff2-4c4b37b8ade1', 'tag': '91db4a29-53e0-45cb-b84b-6d6d03bf4252'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:22:45.544105 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9d4f2ae6-a860-4dbf-be47-ec4bb1d8b67c" -d '{"events": [{"name": "network-changed", "server_uuid": "3c7a50de-b38e-4e96-bff2-4c4b37b8ade1", "tag": "91db4a29-53e0-45cb-b84b-6d6d03bf4252"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:22:45.568089 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d7404d8-2f63-4cd7-aa99-fcde62c9b82f service neutron] Pushing event updated for resources: {'Port': ['ID=91db4a29-53e0-45cb-b84b-6d6d03bf4252,revision_number=3']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:45.582080 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:22:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-08c58428-26a8-4ee9-aa89-a9266ba7e6d0 x-openstack-request-id: req-08c58428-26a8-4ee9-aa89-a9266ba7e6d0 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:22:45.582361 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3c7a50de-b38e-4e96-bff2-4c4b37b8ade1", "tag": "91db4a29-53e0-45cb-b84b-6d6d03bf4252", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:22:45.582736 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-08c58428-26a8-4ee9-aa89-a9266ba7e6d0 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:22:45.583130 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3c7a50de-b38e-4e96-bff2-4c4b37b8ade1', 'tag': '91db4a29-53e0-45cb-b84b-6d6d03bf4252', 'status': 'completed', 'code': 200} Nov 11 17:22:45.652415 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d4f2ae6-a860-4dbf-be47-ec4bb1d8b67c req-67b31ccc-23bc-499e-a052-c2f9fbd02334 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:45.653997 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9d4f2ae6-a860-4dbf-be47-ec4bb1d8b67c req-67b31ccc-23bc-499e-a052-c2f9fbd02334 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=cda486fa48ba43ef850a91d2cc5fca1d&device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 1096 time: 0.0414588 Nov 11 17:22:45.763582 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d4f2ae6-a860-4dbf-be47-ec4bb1d8b67c req-09507c64-eac4-415f-8274-af4f8de50158 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:45.765109 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9d4f2ae6-a860-4dbf-be47-ec4bb1d8b67c req-09507c64-eac4-415f-8274-af4f8de50158 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=cda486fa48ba43ef850a91d2cc5fca1d&shared=False HTTP/1.1" status: 200 len: 908 time: 0.0986593 Nov 11 17:22:45.864073 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d4f2ae6-a860-4dbf-be47-ec4bb1d8b67c req-7838f266-1733-40d2-a398-4e25b97fbf23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:45.865509 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9d4f2ae6-a860-4dbf-be47-ec4bb1d8b67c req-7838f266-1733-40d2-a398-4e25b97fbf23 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0893443 Nov 11 17:22:45.947701 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-f3f1997d-c831-491f-a1ed-0aa7b409b56f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:45.949162 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-f3f1997d-c831-491f-a1ed-0aa7b409b56f service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=cda486fa48ba43ef850a91d2cc5fca1d&device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 1096 time: 0.0413175 Nov 11 17:22:45.991087 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-4fbddf21-5a50-40d8-81d4-6b32ea37050b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=91db4a29-53e0-45cb-b84b-6d6d03bf4252 HTTP/1.1" status: 200 len: 217 time: 0.0339200 Nov 11 17:22:46.041206 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-9a625060-ff37-4241-9707-88e86b56067c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:46.042622 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-9a625060-ff37-4241-9707-88e86b56067c service neutron] 10.222.0.10 "GET /v2.0/subnets?id=d68553ee-3443-497b-8d4d-d6a614d8ae12 HTTP/1.1" status: 200 len: 847 time: 0.0425296 Nov 11 17:22:46.078598 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-4a5dfd70-6c75-4fdc-a721-f296d86ce7b3 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=6ef38ec7-2801-48d8-a258-bd68f4aeffc2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0271313 Nov 11 17:22:46.193652 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-708ea098-92b0-4069-b82b-9d2d1bf17c64 req-6144a12e-913d-45a7-a488-435804703301 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:46.195136 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-708ea098-92b0-4069-b82b-9d2d1bf17c64 req-6144a12e-913d-45a7-a488-435804703301 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 943 time: 0.1005723 Nov 11 17:22:46.215377 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-1a7ab60b-575b-4b16-ade5-727bad5d8822 service neutron] 10.222.0.10 "GET /v2.0/networks/6ef38ec7-2801-48d8-a258-bd68f4aeffc2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1284647 Nov 11 17:22:46.557813 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-708ea098-92b0-4069-b82b-9d2d1bf17c64 req-47e07218-f68c-4e1b-8af0-941d4044697c tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3534846 Nov 11 17:22:46.583586 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d80e9f87-19f9-41f9-9783-56e9ebe5d35b req-cfff3a52-f7be-4d08-9195-fb85f9e55842 service neutron] 10.222.0.10 "GET /v2.0/networks/6ef38ec7-2801-48d8-a258-bd68f4aeffc2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1048086 Nov 11 17:22:46.906088 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:47.672414 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d0ab39c-b440-4564-98a7-627550f9cf8d req-b83301e1-ce82-4643-a273-41ff38569b32 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:47.673755 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7d0ab39c-b440-4564-98a7-627550f9cf8d req-b83301e1-ce82-4643-a273-41ff38569b32 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 943 time: 0.0483093 Nov 11 17:22:47.723543 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7d0ab39c-b440-4564-98a7-627550f9cf8d req-ad3e7adc-a832-4051-a27a-5a33ad891193 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437624 Nov 11 17:22:48.849291 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ef57dc8-9f15-4d6a-ba72-5b27dcd8b08b req-b38c5597-0cfc-494b-8284-9fefad916e3f tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:48.850760 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6ef57dc8-9f15-4d6a-ba72-5b27dcd8b08b req-b38c5597-0cfc-494b-8284-9fefad916e3f tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 943 time: 0.0530829 Nov 11 17:22:48.896169 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6ef57dc8-9f15-4d6a-ba72-5b27dcd8b08b req-2bfa93fe-434b-4713-8bd5-5c0c33dd26af tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388842 Nov 11 17:22:49.639067 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 91db4a29-53e0-45cb-b84b-6d6d03bf4252 details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:22:49.734620 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 91db4a29-53e0-45cb-b84b-6d6d03bf4252, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=91db4a29-53e0-45cb-b84b-6d6d03bf4252,segment=NetworkSegment(753ecf25-f3e0-45e8-979a-6bf9fed6081c),segment_id=753ecf25-f3e0-45e8-979a-6bf9fed6081c)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:22:49.750409 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '91db4a29-53e0-45cb-b84b-6d6d03bf4252', 'network_id': '6ef38ec7-2801-48d8-a258-bd68f4aeffc2', 'port_id': '91db4a29-53e0-45cb-b84b-6d6d03bf4252', 'mac_address': 'fa:16:3e:f4:3f:1a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 519, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd68553ee-3443-497b-8d4d-d6a614d8ae12', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:22:49.788818 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:49.801438 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 91db4a29-53e0-45cb-b84b-6d6d03bf4252 {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:22:49.820769 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 91db4a29-53e0-45cb-b84b-6d6d03bf4252, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=91db4a29-53e0-45cb-b84b-6d6d03bf4252,segment=NetworkSegment(753ecf25-f3e0-45e8-979a-6bf9fed6081c),segment_id=753ecf25-f3e0-45e8-979a-6bf9fed6081c)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:22:49.894724 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:49.946489 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=91db4a29-53e0-45cb-b84b-6d6d03bf4252,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:49.954755 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:49.955109 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:49.955458 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:49.955799 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:49.956165 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:49.956501 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:49.956834 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:49.957158 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:49.957486 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:49.957820 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:49.958139 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:49.958460 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:22:50.011407 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-955e5174-de54-4465-847c-79db65714939 req-e6a19287-870f-484b-bc30-49a2d2d3582f tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:50.012871 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-955e5174-de54-4465-847c-79db65714939 req-e6a19287-870f-484b-bc30-49a2d2d3582f tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 944 time: 0.0480673 Nov 11 17:22:50.061110 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-955e5174-de54-4465-847c-79db65714939 req-b2fc0d54-5e21-498c-a498-adce6611ba99 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422995 Nov 11 17:22:50.175462 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['91db4a29-53e0-45cb-b84b-6d6d03bf4252'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:22:51.175172 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7a0c317-48d5-4ea4-a39b-143054d1d03f req-fadaafcf-6f77-476d-90e8-4b0e7c80bcc5 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:51.176626 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e7a0c317-48d5-4ea4-a39b-143054d1d03f req-fadaafcf-6f77-476d-90e8-4b0e7c80bcc5 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 944 time: 0.0478265 Nov 11 17:22:51.223049 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-e7a0c317-48d5-4ea4-a39b-143054d1d03f req-974c2cca-6b8c-4791-8cfa-afb59481e162 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399337 Nov 11 17:22:51.652982 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 91db4a29-53e0-45cb-b84b-6d6d03bf4252 up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:22:51.757410 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port 91db4a29-53e0-45cb-b84b-6d6d03bf4252 completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:22:51.761261 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 91db4a29-53e0-45cb-b84b-6d6d03bf4252 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:22:51.761628 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:51.839684 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:51.863370 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3c7a50de-b38e-4e96-bff2-4c4b37b8ade1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '91db4a29-53e0-45cb-b84b-6d6d03bf4252'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:22:51.865591 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bf8f0d26-a982-41e7-8d9d-c242bad04303" -d '{"events": [{"server_uuid": "3c7a50de-b38e-4e96-bff2-4c4b37b8ade1", "name": "network-vif-plugged", "status": "completed", "tag": "91db4a29-53e0-45cb-b84b-6d6d03bf4252"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:22:51.877976 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 91db4a29-53e0-45cb-b84b-6d6d03bf4252, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=91db4a29-53e0-45cb-b84b-6d6d03bf4252,segment=NetworkSegment(753ecf25-f3e0-45e8-979a-6bf9fed6081c),segment_id=753ecf25-f3e0-45e8-979a-6bf9fed6081c)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:22:51.905443 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:22:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5379e210-3e68-4636-a95b-a742305930b4 x-openstack-request-id: req-5379e210-3e68-4636-a95b-a742305930b4 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:22:51.905725 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3c7a50de-b38e-4e96-bff2-4c4b37b8ade1", "name": "network-vif-plugged", "status": "completed", "tag": "91db4a29-53e0-45cb-b84b-6d6d03bf4252", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:22:51.905968 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-5379e210-3e68-4636-a95b-a742305930b4 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:22:51.906349 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3c7a50de-b38e-4e96-bff2-4c4b37b8ade1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '91db4a29-53e0-45cb-b84b-6d6d03bf4252', 'code': 200} Nov 11 17:22:51.951919 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:51.999767 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=91db4a29-53e0-45cb-b84b-6d6d03bf4252,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:52.211832 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a739670-e788-4f37-be0c-4df91278e03b req-e9e5ff3d-036d-43af-a02c-0eac5c2a356f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:52.213954 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3a739670-e788-4f37-be0c-4df91278e03b req-e9e5ff3d-036d-43af-a02c-0eac5c2a356f service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 1098 time: 0.0394468 Nov 11 17:22:52.261161 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3a739670-e788-4f37-be0c-4df91278e03b req-434f09f7-e58d-4f19-8247-4980c427f755 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405307 Nov 11 17:22:52.338902 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97de23df-d173-4b67-967d-a83a6004d513 req-24b5aebe-5a43-4172-8f23-569feaf2e0ab tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:52.340446 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-97de23df-d173-4b67-967d-a83a6004d513 req-24b5aebe-5a43-4172-8f23-569feaf2e0ab tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 945 time: 0.0515702 Nov 11 17:22:52.385854 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-97de23df-d173-4b67-967d-a83a6004d513 req-3daf7cf7-f3cc-40ee-9af0-8a663d1029f4 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396559 Nov 11 17:22:53.504781 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dbb1249-c9f4-49c5-8cb4-b94fd918b4b8 req-d1a6fd67-b69b-49fc-b1fb-ceba843ccd26 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:53.506309 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4dbb1249-c9f4-49c5-8cb4-b94fd918b4b8 req-d1a6fd67-b69b-49fc-b1fb-ceba843ccd26 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 945 time: 0.0501184 Nov 11 17:22:53.556921 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4dbb1249-c9f4-49c5-8cb4-b94fd918b4b8 req-50b3f409-e9f0-4caa-9e71-e427266bd521 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429213 Nov 11 17:22:54.669587 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5591514e-b843-4753-b943-fc358fe9bcbf req-e8305d50-64f4-4a80-b14a-64a764a7ee6e tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:54.671093 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5591514e-b843-4753-b943-fc358fe9bcbf req-e8305d50-64f4-4a80-b14a-64a764a7ee6e tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 945 time: 0.0472810 Nov 11 17:22:54.718664 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5591514e-b843-4753-b943-fc358fe9bcbf req-bbe24c65-93a6-4f84-9e4d-67a5265ae0c5 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416906 Nov 11 17:22:56.015425 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4483b051-3b85-4039-97b8-d1c3778410d9 req-f33bf476-1ff6-4a81-88dc-6011b7b2d7c4 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:56.016966 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4483b051-3b85-4039-97b8-d1c3778410d9 req-f33bf476-1ff6-4a81-88dc-6011b7b2d7c4 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 945 time: 0.0565324 Nov 11 17:22:56.070660 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4483b051-3b85-4039-97b8-d1c3778410d9 req-0890853e-1d27-443d-bff5-0302d858353e tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463254 Nov 11 17:22:57.187234 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e24cbbb-95be-4172-ab7a-c79ca11416ca req-8772e4d3-d156-41c7-8b41-4066bb2b1877 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:57.188783 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e24cbbb-95be-4172-ab7a-c79ca11416ca req-8772e4d3-d156-41c7-8b41-4066bb2b1877 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 945 time: 0.0488880 Nov 11 17:22:57.238512 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e24cbbb-95be-4172-ab7a-c79ca11416ca req-5d9eae2d-9544-4e7d-8186-7e1898d82bf9 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432789 Nov 11 17:22:57.485226 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18b7624f-2889-42b3-9a1f-387cb4f7b266 req-80670415-2090-495a-99df-57e86eb0bfa9 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:57.486955 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-18b7624f-2889-42b3-9a1f-387cb4f7b266 req-80670415-2090-495a-99df-57e86eb0bfa9 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.10 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 945 time: 0.0545919 Nov 11 17:22:57.578345 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-18b7624f-2889-42b3-9a1f-387cb4f7b266 req-cb665ffe-e911-4cb4-9bd7-9fe83b0b53e6 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Deleting port 91db4a29-53e0-45cb-b84b-6d6d03bf4252 {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:22:57.578717 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-18b7624f-2889-42b3-9a1f-387cb4f7b266 req-cb665ffe-e911-4cb4-9bd7-9fe83b0b53e6 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:57.669295 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-18b7624f-2889-42b3-9a1f-387cb4f7b266 req-cb665ffe-e911-4cb4-9bd7-9fe83b0b53e6 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] For port 91db4a29-53e0-45cb-b84b-6d6d03bf4252, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=91db4a29-53e0-45cb-b84b-6d6d03bf4252,segment=NetworkSegment(753ecf25-f3e0-45e8-979a-6bf9fed6081c),segment_id=753ecf25-f3e0-45e8-979a-6bf9fed6081c)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:22:57.669650 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-18b7624f-2889-42b3-9a1f-387cb4f7b266 req-cb665ffe-e911-4cb4-9bd7-9fe83b0b53e6 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:57.685498 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-18b7624f-2889-42b3-9a1f-387cb4f7b266 req-cb665ffe-e911-4cb4-9bd7-9fe83b0b53e6 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Calling delete_port for 91db4a29-53e0-45cb-b84b-6d6d03bf4252 owned by compute:nova {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:22:57.854405 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-18b7624f-2889-42b3-9a1f-387cb4f7b266 req-cb665ffe-e911-4cb4-9bd7-9fe83b0b53e6 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:57.866239 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['91db4a29-53e0-45cb-b84b-6d6d03bf4252'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:22:57.881112 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb665ffe-e911-4cb4-9bd7-9fe83b0b53e6 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Pushing event deleted for resources: {'Port': ['ID=91db4a29-53e0-45cb-b84b-6d6d03bf4252,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:22:57.931051 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-18b7624f-2889-42b3-9a1f-387cb4f7b266 req-cb665ffe-e911-4cb4-9bd7-9fe83b0b53e6 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] No DVR routers for this DVR port 91db4a29-53e0-45cb-b84b-6d6d03bf4252 on host hv-cinder-69414 {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:22:57.931945 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-18b7624f-2889-42b3-9a1f-387cb4f7b266 req-cb665ffe-e911-4cb4-9bd7-9fe83b0b53e6 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:22:57.935260 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-18b7624f-2889-42b3-9a1f-387cb4f7b266 req-cb665ffe-e911-4cb4-9bd7-9fe83b0b53e6 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.10 "DELETE /v2.0/ports/91db4a29-53e0-45cb-b84b-6d6d03bf4252 HTTP/1.1" status: 204 len: 173 time: 0.4415653 Nov 11 17:22:57.935747 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3c7a50de-b38e-4e96-bff2-4c4b37b8ade1', 'name': 'network-vif-deleted', 'tag': '91db4a29-53e0-45cb-b84b-6d6d03bf4252'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:22:57.937967 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3097f3dc-8e35-43e7-9fe7-e014297c86b1" -d '{"events": [{"server_uuid": "3c7a50de-b38e-4e96-bff2-4c4b37b8ade1", "name": "network-vif-deleted", "tag": "91db4a29-53e0-45cb-b84b-6d6d03bf4252"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:22:57.973703 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:22:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a23993b8-d30d-4aa9-a21e-3bf18e81116a x-openstack-request-id: req-a23993b8-d30d-4aa9-a21e-3bf18e81116a {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:22:57.973984 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3c7a50de-b38e-4e96-bff2-4c4b37b8ade1", "name": "network-vif-deleted", "tag": "91db4a29-53e0-45cb-b84b-6d6d03bf4252", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:22:57.974238 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-a23993b8-d30d-4aa9-a21e-3bf18e81116a {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:22:57.974667 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3c7a50de-b38e-4e96-bff2-4c4b37b8ade1', 'name': 'network-vif-deleted', 'tag': '91db4a29-53e0-45cb-b84b-6d6d03bf4252', 'status': 'completed', 'code': 200} Nov 11 17:22:58.343971 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-fd843e02-4f8a-427c-b0c7-2737eed22527 req-6d55c27a-e82a-4059-9a42-616d48b52c93 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=3c7a50de-b38e-4e96-bff2-4c4b37b8ade1 HTTP/1.1" status: 200 len: 210 time: 0.0255980 Nov 11 17:22:59.605975 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-31755802-56cc-4366-9e10-3fb805a41991 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:22:59.607431 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-31755802-56cc-4366-9e10-3fb805a41991 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/networks?id=6ef38ec7-2801-48d8-a258-bd68f4aeffc2 HTTP/1.1" status: 200 len: 807 time: 0.1024148 Nov 11 17:22:59.623402 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-82b2d2ef-6caf-4e32-956e-f54b7d000dd1 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/quotas/cda486fa48ba43ef850a91d2cc5fca1d HTTP/1.1" status: 200 len: 375 time: 0.0096893 Nov 11 17:22:59.653701 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-39539af5-9889-4b0f-9e9a-10ef71b98c99 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=cda486fa48ba43ef850a91d2cc5fca1d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0250342 Nov 11 17:22:59.750580 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-924ff639-6c50-4015-bf0a-9b115eb89a1b service neutron] 10.222.0.16 "GET /v2.0/networks/6ef38ec7-2801-48d8-a258-bd68f4aeffc2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0901988 Nov 11 17:22:59.837902 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-6c2ed011-e36d-474e-b21f-ecc46a5f4f0a service neutron] 10.222.0.16 "GET /v2.0/networks/6ef38ec7-2801-48d8-a258-bd68f4aeffc2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812571 Nov 11 17:23:00.082836 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8a49d3a7-7b03-4ba4-9cc2-0325dd00ae34 req-3f463ac3-ab13-4ed1-a67c-4180743a9832 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 210 time: 0.0264354 Nov 11 17:23:00.956845 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-be57f138-8839-4a4e-a361-a7d97df24902 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:01.184013 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-31dc3dfd-1827-4f66-ba8b-cdd49d4c0db3 req-829cf58d-0421-48b3-8e5f-e1cb3c41d568 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 210 time: 0.0304832 Nov 11 17:23:01.714327 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 91db4a29-53e0-45cb-b84b-6d6d03bf4252 no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:23:01.734688 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: 91db4a29-53e0-45cb-b84b-6d6d03bf4252 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:23:01.735323 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 91db4a29-53e0-45cb-b84b-6d6d03bf4252 not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:23:01.842827 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-f62c097f-3cac-444d-8269-76def4e0179f tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:01.844610 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-f62c097f-3cac-444d-8269-76def4e0179f tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.10 "GET /v2.0/networks?id=6ef38ec7-2801-48d8-a258-bd68f4aeffc2 HTTP/1.1" status: 200 len: 807 time: 0.1029141 Nov 11 17:23:01.858434 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-a230d555-c35e-4ae8-b31b-bee6917940d3 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Request body: {'port': {'device_id': 'da42bcbe-103c-4803-90d1-114e7f617141', 'network_id': '6ef38ec7-2801-48d8-a258-bd68f4aeffc2', 'admin_state_up': True, 'tenant_id': 'cda486fa48ba43ef850a91d2cc5fca1d'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:23:02.047547 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-a230d555-c35e-4ae8-b31b-bee6917940d3 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Made reservation on behalf of cda486fa48ba43ef850a91d2cc5fca1d for: {'port': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:23:02.050942 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-a230d555-c35e-4ae8-b31b-bee6917940d3 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:02.105463 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2284bd85-869a-4b36-9847-e4c32fcf1d98 req-7c154851-847f-4b73-b322-fa441c921f52 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:02.106889 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2284bd85-869a-4b36-9847-e4c32fcf1d98 req-7c154851-847f-4b73-b322-fa441c921f52 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 945 time: 0.0711062 Nov 11 17:23:02.218710 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2284bd85-869a-4b36-9847-e4c32fcf1d98 req-3af7e2ab-c455-4fdd-a853-deac57129417 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=b1aa582f-63d4-4eb5-9800-f32d041803cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0866578 Nov 11 17:23:02.245778 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-a230d555-c35e-4ae8-b31b-bee6917940d3 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Allocated IP 172.20.0.5 (6ef38ec7-2801-48d8-a258-bd68f4aeffc2/d68553ee-3443-497b-8d4d-d6a614d8ae12/6ed3a30f-66e5-4020-8ad7-dd0c5806629e) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:23:02.286829 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-abc45727-aef8-4e89-8f92-546eb4724c22 req-7f328d82-07ff-4032-a6e3-707f86b52531 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 210 time: 0.0279620 Nov 11 17:23:02.393570 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-a230d555-c35e-4ae8-b31b-bee6917940d3 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:02.477112 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-a230d555-c35e-4ae8-b31b-bee6917940d3 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:02.520326 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-a230d555-c35e-4ae8-b31b-bee6917940d3 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Network 6ef38ec7-2801-48d8-a258-bd68f4aeffc2 is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:23:02.523411 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-a230d555-c35e-4ae8-b31b-bee6917940d3 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:23:02.527737 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-a230d555-c35e-4ae8-b31b-bee6917940d3 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:23:02.534103 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a230d555-c35e-4ae8-b31b-bee6917940d3 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Pushing event updated for resources: {'Port': ['ID=6ed3a30f-66e5-4020-8ad7-dd0c5806629e,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:02.578057 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-a230d555-c35e-4ae8-b31b-bee6917940d3 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:02.578689 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-a230d555-c35e-4ae8-b31b-bee6917940d3 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:02.661230 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-a230d555-c35e-4ae8-b31b-bee6917940d3 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8064828 Nov 11 17:23:02.673351 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Request body: {'port': {'device_id': 'da42bcbe-103c-4803-90d1-114e7f617141', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:23:02.729421 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:02.980059 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6ed3a30f-66e5-4020-8ad7-dd0c5806629e {{(pid=102324) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:23:02.987185 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:02.999240 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.provisioning_blocks [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Transition to ACTIVE for port object 6ed3a30f-66e5-4020-8ad7-dd0c5806629e will not be triggered until provisioned by entity L2. {{(pid=102324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:23:03.076720 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:03.125098 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Pushing event updated for resources: {'Port': ['ID=6ed3a30f-66e5-4020-8ad7-dd0c5806629e,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:03.199461 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Attempting to bind port 6ed3a30f-66e5-4020-8ad7-dd0c5806629e on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:23:03.199835 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Attempting to bind port 6ed3a30f-66e5-4020-8ad7-dd0c5806629e by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '753ecf25-f3e0-45e8-979a-6bf9fed6081c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 519, 'network_id': '6ef38ec7-2801-48d8-a258-bd68f4aeffc2'}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:23:03.200099 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Attempting to bind port 6ed3a30f-66e5-4020-8ad7-dd0c5806629e on network 6ef38ec7-2801-48d8-a258-bd68f4aeffc2 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:23:03.204429 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Port 6ed3a30f-66e5-4020-8ad7-dd0c5806629e on network 6ef38ec7-2801-48d8-a258-bd68f4aeffc2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:23:03.208643 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Attempting to bind port 6ed3a30f-66e5-4020-8ad7-dd0c5806629e on network 6ef38ec7-2801-48d8-a258-bd68f4aeffc2 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:23:03.209603 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 22, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:23:03.209926 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Checking segment: {'id': '753ecf25-f3e0-45e8-979a-6bf9fed6081c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 519, 'network_id': '6ef38ec7-2801-48d8-a258-bd68f4aeffc2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:23:03.210295 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Bound using segment: {'id': '753ecf25-f3e0-45e8-979a-6bf9fed6081c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 519, 'network_id': '6ef38ec7-2801-48d8-a258-bd68f4aeffc2'} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:23:03.211026 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Bound port: 6ed3a30f-66e5-4020-8ad7-dd0c5806629e, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '753ecf25-f3e0-45e8-979a-6bf9fed6081c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 519, 'network_id': '6ef38ec7-2801-48d8-a258-bd68f4aeffc2'}}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:23:03.211379 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:03.274845 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] For port 6ed3a30f-66e5-4020-8ad7-dd0c5806629e, host hv-cinder-69414, cleared binding levels {{(pid=102324) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:23:03.278776 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] For port 6ed3a30f-66e5-4020-8ad7-dd0c5806629e, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=6ed3a30f-66e5-4020-8ad7-dd0c5806629e,segment=NetworkSegment(753ecf25-f3e0-45e8-979a-6bf9fed6081c),segment_id=753ecf25-f3e0-45e8-979a-6bf9fed6081c)] {{(pid=102324) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:23:03.338112 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a05de97-b5f2-4d38-ae99-cb558bef02ec req-b206464c-867e-44dc-a06c-5b5105529fec tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:03.339633 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4a05de97-b5f2-4d38-ae99-cb558bef02ec req-b206464c-867e-44dc-a06c-5b5105529fec tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 945 time: 0.0497141 Nov 11 17:23:03.365012 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:03.407449 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-372dcbff-89b6-47e7-95a5-81bae01efbf7 req-1b0a3c16-2b69-4e31-80c7-afda1fe048d8 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:03.408011 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:03.408385 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:03.408946 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-372dcbff-89b6-47e7-95a5-81bae01efbf7 req-1b0a3c16-2b69-4e31-80c7-afda1fe048d8 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 943 time: 0.0530767 Nov 11 17:23:03.409748 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] 10.222.0.10 "PUT /v2.0/ports/6ed3a30f-66e5-4020-8ad7-dd0c5806629e HTTP/1.1" status: 200 len: 1093 time: 0.7403915 Nov 11 17:23:03.412067 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'da42bcbe-103c-4803-90d1-114e7f617141', 'tag': '6ed3a30f-66e5-4020-8ad7-dd0c5806629e'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:23:03.414366 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-41049572-270c-4d5b-a327-e0c72167f782" -d '{"events": [{"name": "network-changed", "server_uuid": "da42bcbe-103c-4803-90d1-114e7f617141", "tag": "6ed3a30f-66e5-4020-8ad7-dd0c5806629e"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:23:03.439801 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4a05de97-b5f2-4d38-ae99-cb558bef02ec req-9c36c589-113e-4576-98a9-efec6bb27835 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups?id=b1aa582f-63d4-4eb5-9800-f32d041803cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0940988 Nov 11 17:23:03.453084 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf9303b3-fd29-4a77-bf76-1a6eb5a99876 service neutron] Pushing event updated for resources: {'Port': ['ID=6ed3a30f-66e5-4020-8ad7-dd0c5806629e,revision_number=3']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:03.470900 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-372dcbff-89b6-47e7-95a5-81bae01efbf7 req-b623b16d-0e38-46ca-99e0-0f0227acb5f9 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0553625 Nov 11 17:23:03.493366 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:23:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bb960d70-be9e-414e-9f6b-87895f6b0448 x-openstack-request-id: req-bb960d70-be9e-414e-9f6b-87895f6b0448 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:23:03.494170 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "da42bcbe-103c-4803-90d1-114e7f617141", "tag": "6ed3a30f-66e5-4020-8ad7-dd0c5806629e", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:23:03.494424 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-bb960d70-be9e-414e-9f6b-87895f6b0448 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:23:03.494855 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'da42bcbe-103c-4803-90d1-114e7f617141', 'tag': '6ed3a30f-66e5-4020-8ad7-dd0c5806629e', 'status': 'completed', 'code': 200} Nov 11 17:23:03.557905 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-f9bd2e2b-15b9-4037-bbef-74ff47bb05de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:03.560315 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41049572-270c-4d5b-a327-e0c72167f782 req-3f59f0b5-d556-48ec-b70e-105aaf4a5a70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:03.561930 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-41049572-270c-4d5b-a327-e0c72167f782 req-3f59f0b5-d556-48ec-b70e-105aaf4a5a70 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=cda486fa48ba43ef850a91d2cc5fca1d&device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 1096 time: 0.0429556 Nov 11 17:23:03.665150 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41049572-270c-4d5b-a327-e0c72167f782 req-3f25730a-10ff-461a-a9e3-968054a0bd5f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:03.666692 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-41049572-270c-4d5b-a327-e0c72167f782 req-3f25730a-10ff-461a-a9e3-968054a0bd5f service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=cda486fa48ba43ef850a91d2cc5fca1d&shared=False HTTP/1.1" status: 200 len: 908 time: 0.0934393 Nov 11 17:23:03.763769 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41049572-270c-4d5b-a327-e0c72167f782 req-32a8f64e-5b9d-4f41-a094-2c952f956b2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:03.765109 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-41049572-270c-4d5b-a327-e0c72167f782 req-32a8f64e-5b9d-4f41-a094-2c952f956b2b service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0855927 Nov 11 17:23:03.847565 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-a7e63cd0-7d99-495d-a5f6-03bee9cd8c48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:03.849054 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-a7e63cd0-7d99-495d-a5f6-03bee9cd8c48 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=cda486fa48ba43ef850a91d2cc5fca1d&device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 1096 time: 0.0451005 Nov 11 17:23:03.892981 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-3efd2825-38bd-4771-967e-5e7da77040c1 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=6ed3a30f-66e5-4020-8ad7-dd0c5806629e HTTP/1.1" status: 200 len: 217 time: 0.0336156 Nov 11 17:23:03.945321 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-709953a8-1f0c-4346-af0a-5eabdb40ef8b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:03.946857 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-709953a8-1f0c-4346-af0a-5eabdb40ef8b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=d68553ee-3443-497b-8d4d-d6a614d8ae12 HTTP/1.1" status: 200 len: 847 time: 0.0431652 Nov 11 17:23:03.979110 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-4bc59946-e429-4291-a0fe-05fdad7c02ee service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=6ef38ec7-2801-48d8-a258-bd68f4aeffc2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0246847 Nov 11 17:23:04.070751 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-b34a7bc1-3257-466e-9492-132b784eae8a service neutron] 10.222.0.10 "GET /v2.0/networks/6ef38ec7-2801-48d8-a258-bd68f4aeffc2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837724 Nov 11 17:23:04.084918 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-903ad36d-5ceb-4ea2-a9e6-d08950624361 req-3564aa5c-7d4f-4954-a748-f54e0ea7f5b1 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:04.086611 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-903ad36d-5ceb-4ea2-a9e6-d08950624361 req-3564aa5c-7d4f-4954-a748-f54e0ea7f5b1 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.10 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 945 time: 0.0481594 Nov 11 17:23:04.164662 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8e75c234-3d9a-4b77-ab5c-5bf3a5f502d1 req-3c372a61-ed4a-4c71-bda7-d336539ae53f service neutron] 10.222.0.10 "GET /v2.0/networks/6ef38ec7-2801-48d8-a258-bd68f4aeffc2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829968 Nov 11 17:23:04.183237 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [req-903ad36d-5ceb-4ea2-a9e6-d08950624361 req-4f778855-e067-4f99-bccc-eec39d964621 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Deleting port e641e657-04f2-4767-a7ef-934e2ccd7a0b {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:23:04.183604 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-903ad36d-5ceb-4ea2-a9e6-d08950624361 req-4f778855-e067-4f99-bccc-eec39d964621 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:04.270132 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-903ad36d-5ceb-4ea2-a9e6-d08950624361 req-4f778855-e067-4f99-bccc-eec39d964621 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] For port e641e657-04f2-4767-a7ef-934e2ccd7a0b, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=e641e657-04f2-4767-a7ef-934e2ccd7a0b,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:04.270494 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-903ad36d-5ceb-4ea2-a9e6-d08950624361 req-4f778855-e067-4f99-bccc-eec39d964621 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:04.444813 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-903ad36d-5ceb-4ea2-a9e6-d08950624361 req-4f778855-e067-4f99-bccc-eec39d964621 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:04.445541 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-903ad36d-5ceb-4ea2-a9e6-d08950624361 req-4f778855-e067-4f99-bccc-eec39d964621 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:04.445541 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.l3_db [req-903ad36d-5ceb-4ea2-a9e6-d08950624361 req-4f778855-e067-4f99-bccc-eec39d964621 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Floating IP 4429514e-b44a-4fe9-8e2a-2b27d70a76f9 disassociated. External IP: 172.27.1.240, port: e641e657-04f2-4767-a7ef-934e2ccd7a0b. Nov 11 17:23:04.445791 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [req-903ad36d-5ceb-4ea2-a9e6-d08950624361 req-4f778855-e067-4f99-bccc-eec39d964621 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Calling delete_port for e641e657-04f2-4767-a7ef-934e2ccd7a0b owned by compute:nova {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:23:04.600747 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7c89bc-4bc4-4e40-a421-811d191daed5 req-016dfb64-d7ce-4cbc-abb9-dac7aaeb8f86 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:04.602241 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0a7c89bc-4bc4-4e40-a421-811d191daed5 req-016dfb64-d7ce-4cbc-abb9-dac7aaeb8f86 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 943 time: 0.0542953 Nov 11 17:23:04.607815 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:04.648270 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-903ad36d-5ceb-4ea2-a9e6-d08950624361 req-4f778855-e067-4f99-bccc-eec39d964621 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:04.650482 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0a7c89bc-4bc4-4e40-a421-811d191daed5 req-db1ba04d-10b6-406c-8fbf-20b157ef0d60 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409312 Nov 11 17:23:04.682275 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f778855-e067-4f99-bccc-eec39d964621 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event deleted for resources: {'Port': ['ID=e641e657-04f2-4767-a7ef-934e2ccd7a0b,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:04.715643 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-49975a43-206a-4ae9-8b09-d055f3134f35 req-217a070f-d04b-46d7-8ea0-a80fdce6e099 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 210 time: 0.0311546 Nov 11 17:23:04.822459 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [req-903ad36d-5ceb-4ea2-a9e6-d08950624361 req-4f778855-e067-4f99-bccc-eec39d964621 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Router 98cb701e-467a-4425-90db-9dbc5f732760 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:23:05.190019 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-903ad36d-5ceb-4ea2-a9e6-d08950624361 req-4f778855-e067-4f99-bccc-eec39d964621 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:23:05.200541 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31f0db80-993d-446f-bf70-559cc807f2ff None None] Sync routers for ids ['98cb701e-467a-4425-90db-9dbc5f732760'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:23:05.210433 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31f0db80-993d-446f-bf70-559cc807f2ff None None] Routers {'98cb701e-467a-4425-90db-9dbc5f732760'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:23:05.211326 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-31f0db80-993d-446f-bf70-559cc807f2ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:23:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['98cb701e-467a-4425-90db-9dbc5f732760'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:05.230126 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [req-903ad36d-5ceb-4ea2-a9e6-d08950624361 req-4f778855-e067-4f99-bccc-eec39d964621 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] No DVR routers for this DVR port e641e657-04f2-4767-a7ef-934e2ccd7a0b on host hv-cinder-69414 {{(pid=102323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:23:05.232750 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-903ad36d-5ceb-4ea2-a9e6-d08950624361 req-4f778855-e067-4f99-bccc-eec39d964621 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:05.236167 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-903ad36d-5ceb-4ea2-a9e6-d08950624361 req-4f778855-e067-4f99-bccc-eec39d964621 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.10 "DELETE /v2.0/ports/e641e657-04f2-4767-a7ef-934e2ccd7a0b HTTP/1.1" status: 204 len: 173 time: 1.1403415 Nov 11 17:23:05.236649 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7d89b9bb-0141-4476-b119-26030b8f1e11', 'name': 'network-vif-deleted', 'tag': 'e641e657-04f2-4767-a7ef-934e2ccd7a0b'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:23:05.238868 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-143b61ec-c65d-4398-bc49-9d206e6fcab1" -d '{"events": [{"server_uuid": "7d89b9bb-0141-4476-b119-26030b8f1e11", "name": "network-vif-deleted", "tag": "e641e657-04f2-4767-a7ef-934e2ccd7a0b"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:23:05.276424 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:23:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e20ee78a-17b6-40c6-86c7-d8a57918a057 x-openstack-request-id: req-e20ee78a-17b6-40c6-86c7-d8a57918a057 {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:23:05.276783 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7d89b9bb-0141-4476-b119-26030b8f1e11", "name": "network-vif-deleted", "tag": "e641e657-04f2-4767-a7ef-934e2ccd7a0b", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:23:05.277028 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-e20ee78a-17b6-40c6-86c7-d8a57918a057 {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:23:05.277416 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7d89b9bb-0141-4476-b119-26030b8f1e11', 'name': 'network-vif-deleted', 'tag': 'e641e657-04f2-4767-a7ef-934e2ccd7a0b', 'status': 'completed', 'code': 200} Nov 11 17:23:05.319393 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-31f0db80-993d-446f-bf70-559cc807f2ff None None] Set router 98cb701e-467a-4425-90db-9dbc5f732760 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:23:05.537976 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-31f0db80-993d-446f-bf70-559cc807f2ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a', 'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'mac_address': 'fa:16:3e:04:45:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:18:01Z', 'updated_at': '2021-11-11T17:18:07Z', 'revision_number': 5, 'project_id': '7e951c2eae284261a98b317ec84140db', 'subnets': [{'id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:05.560802 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31f0db80-993d-446f-bf70-559cc807f2ff None None] Checking router: 98cb701e-467a-4425-90db-9dbc5f732760 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:23:05.569286 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31f0db80-993d-446f-bf70-559cc807f2ff None None] Routers {'98cb701e-467a-4425-90db-9dbc5f732760'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:23:05.569875 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-31f0db80-993d-446f-bf70-559cc807f2ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:23:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['98cb701e-467a-4425-90db-9dbc5f732760'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:05.676111 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-31f0db80-993d-446f-bf70-559cc807f2ff None None] Set router 98cb701e-467a-4425-90db-9dbc5f732760 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:23:05.771923 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-755b1568-d7dc-4e37-a88e-090c9aae7b7b req-90042af7-a58a-4bdc-8002-929edabce5ba tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:05.774444 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-755b1568-d7dc-4e37-a88e-090c9aae7b7b req-90042af7-a58a-4bdc-8002-929edabce5ba tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 943 time: 0.0551214 Nov 11 17:23:05.828384 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-755b1568-d7dc-4e37-a88e-090c9aae7b7b req-353a2a49-b256-4e95-a92a-a6819e998360 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467122 Nov 11 17:23:05.835228 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0f6f16e4-4db0-4ba2-92b2-762abb324a30 req-755630ad-881d-4d44-b943-a9a266037400 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d89b9bb-0141-4476-b119-26030b8f1e11 HTTP/1.1" status: 200 len: 210 time: 0.0273857 Nov 11 17:23:05.901533 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-31f0db80-993d-446f-bf70-559cc807f2ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a', 'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'mac_address': 'fa:16:3e:04:45:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:18:01Z', 'updated_at': '2021-11-11T17:18:07Z', 'revision_number': 5, 'project_id': '7e951c2eae284261a98b317ec84140db', 'subnets': [{'id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:05.928739 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31f0db80-993d-446f-bf70-559cc807f2ff None None] The sync data for ids ['98cb701e-467a-4425-90db-9dbc5f732760'] in dv-cinder-694140-2-iscsi is: [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:18:02Z', 'revision_number': 4, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a', 'name': '', 'network_id': '10ac93d3-f14d-4df5-a044-d683e35c1ab8', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'mac_address': 'fa:16:3e:04:45:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_interface', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:18:01Z', 'updated_at': '2021-11-11T17:18:07Z', 'revision_number': 5, 'project_id': '7e951c2eae284261a98b317ec84140db', 'subnets': [{'id': 'cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:23:06.146664 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b69f2e6-6ec5-4c8d-808d-1e3d006bf88a None None] New status for floating IP 4429514e-b44a-4fe9-8e2a-2b27d70a76f9: DOWN {{(pid=102325) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:23:06.357085 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:06.949123 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f5f97e-071d-4c3c-a8e4-9e729c297308 req-db222244-82d8-4105-8781-76b206adc37f tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:06.950582 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-03f5f97e-071d-4c3c-a8e4-9e729c297308 req-db222244-82d8-4105-8781-76b206adc37f tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 943 time: 0.0529442 Nov 11 17:23:06.980976 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 36286) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:06.998146 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-03f5f97e-071d-4c3c-a8e4-9e729c297308 req-d544f735-7038-41a8-88d1-60ee50159759 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414369 Nov 11 17:23:07.002411 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:07.033471 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bebefdab-89b9-44e6-8036-791b7a6fdbc1 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:07.055994 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bebefdab-89b9-44e6-8036-791b7a6fdbc1 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:07.202312 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bebefdab-89b9-44e6-8036-791b7a6fdbc1 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:07.204985 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bebefdab-89b9-44e6-8036-791b7a6fdbc1 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:07.206150 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-bebefdab-89b9-44e6-8036-791b7a6fdbc1 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "DELETE /v2.0/security-groups/b1aa582f-63d4-4eb5-9800-f32d041803cf HTTP/1.1" status: 204 len: 168 time: 0.2242026 Nov 11 17:23:07.208886 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36288) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:07.216525 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bebefdab-89b9-44e6-8036-791b7a6fdbc1 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1aa582f-63d4-4eb5-9800-f32d041803cf,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:07.223191 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.api.v2.resource [None req-1fa8ed0d-ef39-4281-b163-d2cb8dc8604f tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] show failed (client error): The resource could not be found. Nov 11 17:23:07.223673 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-1fa8ed0d-ef39-4281-b163-d2cb8dc8604f tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "GET /v2.0/security-groups/b1aa582f-63d4-4eb5-9800-f32d041803cf HTTP/1.1" status: 404 len: 347 time: 0.0137916 Nov 11 17:23:07.226643 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36290) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:07.351134 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-7cdf65c7-f3e7-4c7e-a015-90754910e361 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Deleting port 3fd245e1-8159-48d0-9809-2fa73db43aeb {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:23:07.351468 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7cdf65c7-f3e7-4c7e-a015-90754910e361 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:07.433619 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7cdf65c7-f3e7-4c7e-a015-90754910e361 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:07.433853 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7cdf65c7-f3e7-4c7e-a015-90754910e361 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:07.445661 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-7cdf65c7-f3e7-4c7e-a015-90754910e361 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Calling delete_port for 3fd245e1-8159-48d0-9809-2fa73db43aeb owned by network:floatingip {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:23:07.613090 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7cdf65c7-f3e7-4c7e-a015-90754910e361 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:07.640801 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cdf65c7-f3e7-4c7e-a015-90754910e361 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Pushing event deleted for resources: {'Port': ['ID=3fd245e1-8159-48d0-9809-2fa73db43aeb,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:07.699480 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7cdf65c7-f3e7-4c7e-a015-90754910e361 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks [] for floatingip, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:07.701944 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7cdf65c7-f3e7-4c7e-a015-90754910e361 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:07.703100 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-7cdf65c7-f3e7-4c7e-a015-90754910e361 tempest-AttachVolumeTestJSON-1351072079 tempest-AttachVolumeTestJSON-1351072079-project] 10.222.0.16 "DELETE /v2.0/floatingips/4429514e-b44a-4fe9-8e2a-2b27d70a76f9 HTTP/1.1" status: 204 len: 168 time: 0.4703753 Nov 11 17:23:07.744485 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 6ed3a30f-66e5-4020-8ad7-dd0c5806629e details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:23:07.841344 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 6ed3a30f-66e5-4020-8ad7-dd0c5806629e, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=6ed3a30f-66e5-4020-8ad7-dd0c5806629e,segment=NetworkSegment(753ecf25-f3e0-45e8-979a-6bf9fed6081c),segment_id=753ecf25-f3e0-45e8-979a-6bf9fed6081c)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:07.852252 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '6ed3a30f-66e5-4020-8ad7-dd0c5806629e', 'network_id': '6ef38ec7-2801-48d8-a258-bd68f4aeffc2', 'port_id': '6ed3a30f-66e5-4020-8ad7-dd0c5806629e', 'mac_address': 'fa:16:3e:a5:76:1c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 519, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd68553ee-3443-497b-8d4d-d6a614d8ae12', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:23:07.890783 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:07.904148 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6ed3a30f-66e5-4020-8ad7-dd0c5806629e {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:23:07.923729 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 6ed3a30f-66e5-4020-8ad7-dd0c5806629e, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=6ed3a30f-66e5-4020-8ad7-dd0c5806629e,segment=NetworkSegment(753ecf25-f3e0-45e8-979a-6bf9fed6081c),segment_id=753ecf25-f3e0-45e8-979a-6bf9fed6081c)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:07.967872 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:08.015414 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=6ed3a30f-66e5-4020-8ad7-dd0c5806629e,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:08.123630 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd4aa7b3-478b-4804-8f46-c92d70fc46ee req-7adbc40e-2082-4b06-b1d4-d59d3423f21e tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:08.125110 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bd4aa7b3-478b-4804-8f46-c92d70fc46ee req-7adbc40e-2082-4b06-b1d4-d59d3423f21e tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 944 time: 0.0572925 Nov 11 17:23:08.176015 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bd4aa7b3-478b-4804-8f46-c92d70fc46ee req-ad6c7080-2010-48ee-a5d5-0ca415031efb tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434048 Nov 11 17:23:08.220734 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['6ed3a30f-66e5-4020-8ad7-dd0c5806629e'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:23:09.292166 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de588ee1-b5e8-4bea-b050-44e66ad7826a req-b26af2b7-3418-4b93-a1cf-e868e3ee4e40 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:09.293638 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-de588ee1-b5e8-4bea-b050-44e66ad7826a req-b26af2b7-3418-4b93-a1cf-e868e3ee4e40 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 944 time: 0.0486155 Nov 11 17:23:09.341267 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-de588ee1-b5e8-4bea-b050-44e66ad7826a req-24ccd87b-ade4-42bf-87c5-8eb8ccd316d6 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416579 Nov 11 17:23:09.747637 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 6ed3a30f-66e5-4020-8ad7-dd0c5806629e up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:23:09.866645 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port 6ed3a30f-66e5-4020-8ad7-dd0c5806629e completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:23:09.871476 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 6ed3a30f-66e5-4020-8ad7-dd0c5806629e triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:09.871848 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:09.951363 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:09.973675 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'da42bcbe-103c-4803-90d1-114e7f617141', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6ed3a30f-66e5-4020-8ad7-dd0c5806629e'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:23:09.975901 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-30d746e0-54b5-422f-82c1-c316ba42e5c3" -d '{"events": [{"server_uuid": "da42bcbe-103c-4803-90d1-114e7f617141", "name": "network-vif-plugged", "status": "completed", "tag": "6ed3a30f-66e5-4020-8ad7-dd0c5806629e"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:23:09.988835 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 6ed3a30f-66e5-4020-8ad7-dd0c5806629e, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=6ed3a30f-66e5-4020-8ad7-dd0c5806629e,segment=NetworkSegment(753ecf25-f3e0-45e8-979a-6bf9fed6081c),segment_id=753ecf25-f3e0-45e8-979a-6bf9fed6081c)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:10.016140 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:23:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4b9987aa-9ad0-47ab-8ad8-a537acd6ae6b x-openstack-request-id: req-4b9987aa-9ad0-47ab-8ad8-a537acd6ae6b {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:23:10.016466 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "da42bcbe-103c-4803-90d1-114e7f617141", "name": "network-vif-plugged", "status": "completed", "tag": "6ed3a30f-66e5-4020-8ad7-dd0c5806629e", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:23:10.016758 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-4b9987aa-9ad0-47ab-8ad8-a537acd6ae6b {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:23:10.017278 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'da42bcbe-103c-4803-90d1-114e7f617141', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6ed3a30f-66e5-4020-8ad7-dd0c5806629e', 'code': 200} Nov 11 17:23:10.053667 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:10.054459 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device e641e657-04f2-4767-a7ef-934e2ccd7a0b no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:23:10.091545 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: e641e657-04f2-4767-a7ef-934e2ccd7a0b {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:23:10.091959 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device e641e657-04f2-4767-a7ef-934e2ccd7a0b not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:23:10.123800 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=6ed3a30f-66e5-4020-8ad7-dd0c5806629e,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:10.279809 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-137ccbc8-a35d-4946-92db-af992fd8ebce req-9a36afab-72df-44b1-8e8d-1e76e479acd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:10.281296 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-137ccbc8-a35d-4946-92db-af992fd8ebce req-9a36afab-72df-44b1-8e8d-1e76e479acd7 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 1098 time: 0.0427518 Nov 11 17:23:10.329404 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-137ccbc8-a35d-4946-92db-af992fd8ebce req-7298dabc-47ac-4575-b4f6-61ad90b470dc service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0360172 Nov 11 17:23:10.461569 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81b28a4c-8c64-4cd1-8879-8e15041ae9be req-a0ee6eb1-c876-4db1-8f0f-dbc5bcb4d587 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:10.463854 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-81b28a4c-8c64-4cd1-8879-8e15041ae9be req-a0ee6eb1-c876-4db1-8f0f-dbc5bcb4d587 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 945 time: 0.0532899 Nov 11 17:23:10.513327 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-81b28a4c-8c64-4cd1-8879-8e15041ae9be req-00972ea3-68e0-4531-9324-c64f9b8a2290 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435076 Nov 11 17:23:11.558435 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36332) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:11.636632 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f778e6c-f53d-4304-a45f-c056f36b7b83 req-2b059e5a-b705-4776-a9d6-2adfd9bed69b tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:11.638172 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8f778e6c-f53d-4304-a45f-c056f36b7b83 req-2b059e5a-b705-4776-a9d6-2adfd9bed69b tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 945 time: 0.0516608 Nov 11 17:23:11.687518 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8f778e6c-f53d-4304-a45f-c056f36b7b83 req-b443bd7e-f237-46d3-bf14-c074779e1e6c tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433502 Nov 11 17:23:11.957572 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-626b4b55-e1e8-4479-a00c-9d4e022ab258 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-394221'] for router_interface, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:12.201735 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-626b4b55-e1e8-4479-a00c-9d4e022ab258 admin admin] Deleting port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:23:12.202070 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-626b4b55-e1e8-4479-a00c-9d4e022ab258 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:12.279051 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-626b4b55-e1e8-4479-a00c-9d4e022ab258 admin admin] For port f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:12.279321 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-626b4b55-e1e8-4479-a00c-9d4e022ab258 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:12.292036 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-626b4b55-e1e8-4479-a00c-9d4e022ab258 admin admin] Calling delete_port for f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a owned by network:router_interface {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:23:12.538836 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-626b4b55-e1e8-4479-a00c-9d4e022ab258 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:12.567640 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-626b4b55-e1e8-4479-a00c-9d4e022ab258 admin admin] Pushing event deleted for resources: {'Port': ['ID=f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:12.734698 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-626b4b55-e1e8-4479-a00c-9d4e022ab258 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8103781', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-393853'] for router_interface, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:12.874301 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9189bfd9-cc59-493a-a1bd-6208f0cb9cc4 req-7d142259-3ef3-42c9-b89a-f42ee5e56d22 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:12.875714 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9189bfd9-cc59-493a-a1bd-6208f0cb9cc4 req-7d142259-3ef3-42c9-b89a-f42ee5e56d22 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 945 time: 0.0973341 Nov 11 17:23:12.967070 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9189bfd9-cc59-493a-a1bd-6208f0cb9cc4 req-53230da8-82b9-4f7b-ba8a-6c8d83420f6d tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0844531 Nov 11 17:23:13.025676 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-626b4b55-e1e8-4479-a00c-9d4e022ab258 admin admin] Router 98cb701e-467a-4425-90db-9dbc5f732760 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:23:13.142648 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-626b4b55-e1e8-4479-a00c-9d4e022ab258 admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:23:13.150959 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-626b4b55-e1e8-4479-a00c-9d4e022ab258 admin admin] 10.222.0.16 "PUT /v2.0/routers/98cb701e-467a-4425-90db-9dbc5f732760/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5882638 Nov 11 17:23:13.150959 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36340) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:13.154148 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a4da8a0-20eb-4cdd-83dd-916f742a9550 None None] Sync routers for ids ['98cb701e-467a-4425-90db-9dbc5f732760'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:23:13.167524 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a4da8a0-20eb-4cdd-83dd-916f742a9550 None None] Routers {'98cb701e-467a-4425-90db-9dbc5f732760'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:23:13.168237 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-3a4da8a0-20eb-4cdd-83dd-916f742a9550 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:23:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['98cb701e-467a-4425-90db-9dbc5f732760'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:13.259531 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e5335af8-092d-4a55-8a09-d7f048dd918a admin admin] Publish callbacks [] for router, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:13.365757 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e5335af8-092d-4a55-8a09-d7f048dd918a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:13.367827 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-3a4da8a0-20eb-4cdd-83dd-916f742a9550 None None] Set router 98cb701e-467a-4425-90db-9dbc5f732760 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:23:13.482640 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-e5335af8-092d-4a55-8a09-d7f048dd918a admin admin] Deleting port 11e3c4be-b19e-49b8-91f8-93740d537aa6 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:23:13.482974 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e5335af8-092d-4a55-8a09-d7f048dd918a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:13.561372 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-3a4da8a0-20eb-4cdd-83dd-916f742a9550 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141'}], 'enable_snat': True}, 'gw_port_id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:23:12Z', 'revision_number': 5, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port': {'id': '11e3c4be-b19e-49b8-91f8-93740d537aa6', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:7a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98cb701e-467a-4425-90db-9dbc5f732760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:17:59Z', 'updated_at': '2021-11-11T17:18:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:13.574190 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-e5335af8-092d-4a55-8a09-d7f048dd918a admin admin] For port 11e3c4be-b19e-49b8-91f8-93740d537aa6, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=11e3c4be-b19e-49b8-91f8-93740d537aa6,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:13.574190 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e5335af8-092d-4a55-8a09-d7f048dd918a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:13.587175 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-e5335af8-092d-4a55-8a09-d7f048dd918a admin admin] Calling delete_port for 11e3c4be-b19e-49b8-91f8-93740d537aa6 owned by network:router_gateway {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:23:13.588817 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a4da8a0-20eb-4cdd-83dd-916f742a9550 None None] Checking router: 98cb701e-467a-4425-90db-9dbc5f732760 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:23:13.597055 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a4da8a0-20eb-4cdd-83dd-916f742a9550 None None] Routers {'98cb701e-467a-4425-90db-9dbc5f732760'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:23:13.597650 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-3a4da8a0-20eb-4cdd-83dd-916f742a9550 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:23:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['98cb701e-467a-4425-90db-9dbc5f732760'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:13.683643 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-3a4da8a0-20eb-4cdd-83dd-916f742a9550 None None] Set router 98cb701e-467a-4425-90db-9dbc5f732760 gateway port host: None {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:23:13.736852 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-3a4da8a0-20eb-4cdd-83dd-916f742a9550 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:23:13Z', 'revision_number': 6, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port_host': None}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:13.766069 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a4da8a0-20eb-4cdd-83dd-916f742a9550 None None] The sync data for ids ['98cb701e-467a-4425-90db-9dbc5f732760'] in dv-cinder-694140-2-iscsi is: [{'id': '98cb701e-467a-4425-90db-9dbc5f732760', 'name': 'tempest-AttachVolumeTestJSON-1075904326-router', 'tenant_id': '7e951c2eae284261a98b317ec84140db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:17:58Z', 'updated_at': '2021-11-11T17:23:13Z', 'revision_number': 6, 'project_id': '7e951c2eae284261a98b317ec84140db', 'gw_port_host': None}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:23:13.836154 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e5335af8-092d-4a55-8a09-d7f048dd918a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:13.861945 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5335af8-092d-4a55-8a09-d7f048dd918a admin admin] Pushing event deleted for resources: {'Port': ['ID=11e3c4be-b19e-49b8-91f8-93740d537aa6,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:13.922938 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e5335af8-092d-4a55-8a09-d7f048dd918a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-397207'] for router_gateway, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.021529 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e5335af8-092d-4a55-8a09-d7f048dd918a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-424448', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7353'] for router, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.023975 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e5335af8-092d-4a55-8a09-d7f048dd918a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.131089 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e5335af8-092d-4a55-8a09-d7f048dd918a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-424459'] for router, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.133315 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e5335af8-092d-4a55-8a09-d7f048dd918a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 98cb701e-467a-4425-90db-9dbc5f732760 {{(pid=102323) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 17:23:14.149656 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e5335af8-092d-4a55-8a09-d7f048dd918a admin admin] Publish callbacks [] for router, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.150800 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-e5335af8-092d-4a55-8a09-d7f048dd918a admin admin] 10.222.0.16 "DELETE /v2.0/routers/98cb701e-467a-4425-90db-9dbc5f732760 HTTP/1.1" status: 204 len: 168 time: 0.9989262 Nov 11 17:23:14.153428 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 36354) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:14.183652 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a394f37-456b-48ab-b097-29f1722a05dc req-2d809859-c80e-4afe-8048-8681c21bc6eb tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:14.185269 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7a394f37-456b-48ab-b097-29f1722a05dc req-2d809859-c80e-4afe-8048-8681c21bc6eb tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 945 time: 0.0647178 Nov 11 17:23:14.207487 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_v2 [None req-7314dfbb-5969-423a-8343-b4a9022aee63 admin admin] Deleting subnet cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba {{(pid=102324) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:23:14.210752 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7314dfbb-5969-423a-8343-b4a9022aee63 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.234343 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7a394f37-456b-48ab-b097-29f1722a05dc req-22cc53bf-0077-4132-9a39-940b04b0d831 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429449 Nov 11 17:23:14.245495 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7314dfbb-5969-423a-8343-b4a9022aee63 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5895837'] for subnet, precommit_delete_associations {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.324492 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7314dfbb-5969-423a-8343-b4a9022aee63 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.419532 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7314dfbb-5969-423a-8343-b4a9022aee63 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5436208', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5275461'] for subnet, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.454704 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7314dfbb-5969-423a-8343-b4a9022aee63 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:14.461385 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7314dfbb-5969-423a-8343-b4a9022aee63 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.470793 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-7314dfbb-5969-423a-8343-b4a9022aee63 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/cc8d84e9-51fc-4ff2-a8ab-efac5b2a05ba HTTP/1.1" status: 204 len: 168 time: 0.3104267 Nov 11 17:23:14.470793 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 36356) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:14.471039 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-144dfe8a-e365-482b-8142-cce1a26a366c None None] Network 10ac93d3-f14d-4df5-a044-d683e35c1ab8 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:23:14.540121 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.593419 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] Deleting port a93a01da-484d-42e3-931f-f6e697d1abd5 {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:23:14.593637 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.662910 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] For port a93a01da-484d-42e3-931f-f6e697d1abd5, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=a93a01da-484d-42e3-931f-f6e697d1abd5,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:14.663778 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.670317 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78bda472-bb50-4456-9f1b-340bb27dbb5f None None] DHCP port deletion for 10ac93d3-f14d-4df5-a044-d683e35c1ab8 request from dv-cinder-694140-2-iscsi {{(pid=102325) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 11 17:23:14.676564 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] Calling delete_port for a93a01da-484d-42e3-931f-f6e697d1abd5 owned by network:dhcp {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:23:14.724138 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-78bda472-bb50-4456-9f1b-340bb27dbb5f None None] Deleting port a93a01da-484d-42e3-931f-f6e697d1abd5 {{(pid=102325) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:23:14.724507 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-78bda472-bb50-4456-9f1b-340bb27dbb5f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.790712 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-78bda472-bb50-4456-9f1b-340bb27dbb5f None None] For port a93a01da-484d-42e3-931f-f6e697d1abd5, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=a93a01da-484d-42e3-931f-f6e697d1abd5,segment=NetworkSegment(41c0a3f1-0319-4822-972b-4361c6e0b0df),segment_id=41c0a3f1-0319-4822-972b-4361c6e0b0df)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:14.791197 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-78bda472-bb50-4456-9f1b-340bb27dbb5f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.805069 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-78bda472-bb50-4456-9f1b-340bb27dbb5f None None] Calling delete_port for a93a01da-484d-42e3-931f-f6e697d1abd5 owned by network:dhcp {{(pid=102325) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:23:14.829901 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.858672 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] Pushing event deleted for resources: {'Port': ['ID=a93a01da-484d-42e3-931f-f6e697d1abd5,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:14.862750 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] No DVR routers for this DVR port a93a01da-484d-42e3-931f-f6e697d1abd5 on host dv-cinder-694140-2-iscsi {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:23:14.935223 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.956821 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['10ac93d3-f14d-4df5-a044-d683e35c1ab8']}} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:14.967290 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '41c0a3f1-0319-4822-972b-4361c6e0b0df') {'for_net_delete': True} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:14.967584 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '41c0a3f1-0319-4822-972b-4361c6e0b0df') {} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:14.978133 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5895812'] for segment, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.991334 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:14.997999 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] Releasing vlan 544 on physical network physnet1 to pool {{(pid=102324) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:23:14.998378 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5436270'] for segment, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: Traceback (most recent call last): Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: timer() Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: cb(*args, **kw) Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: return func(*args, **kwargs) Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: self._notify() Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: self.callback(batched_events) Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: event.method(event) Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: return f(self, *a, **k) Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: return self._get(url).json() Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: return self.request(url, 'GET', **kwargs) Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:23:15.000084 dv-cinder-694140-2-iscsi neutron-server[102324]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:23:15.013607 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-78bda472-bb50-4456-9f1b-340bb27dbb5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633'] for port, after_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:15.036559 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78bda472-bb50-4456-9f1b-340bb27dbb5f None None] Pushing event deleted for resources: {'Port': ['ID=a93a01da-484d-42e3-931f-f6e697d1abd5,revision_number=None']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:15.043081 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78bda472-bb50-4456-9f1b-340bb27dbb5f None None] No DVR routers for this DVR port a93a01da-484d-42e3-931f-f6e697d1abd5 on host dv-cinder-694140-2-iscsi {{(pid=102325) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:23:15.128005 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:15.133332 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:15.136763 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] 10.222.0.16 "DELETE /v2.0/networks/10ac93d3-f14d-4df5-a044-d683e35c1ab8 HTTP/1.1" status: 204 len: 168 time: 0.6675816 Nov 11 17:23:15.147367 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-640a8e1a-26f5-4f97-9a88-c50d545a2562 admin admin] Pushing event deleted for resources: {'Network': ['ID=10ac93d3-f14d-4df5-a044-d683e35c1ab8,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:15.357609 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab0ca04-154f-41c4-94d0-53f266563f6e req-24b6524a-426f-4a8e-821c-b6f1552bcf3a tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:15.359165 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1ab0ca04-154f-41c4-94d0-53f266563f6e req-24b6524a-426f-4a8e-821c-b6f1552bcf3a tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 945 time: 0.0560772 Nov 11 17:23:15.413994 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1ab0ca04-154f-41c4-94d0-53f266563f6e req-6fec94fc-af68-4392-b84d-49900baa80a1 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/security-groups?id=f54f1415-3005-4d30-9cbd-6a9342486bb3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487695 Nov 11 17:23:15.471020 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 36362) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:15.516525 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-23394946-6682-47e8-b7b5-cb7406abf8a3 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=7e951c2eae284261a98b317ec84140db&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0443716 Nov 11 17:23:15.519030 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 36364) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:15.559020 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:23:15.570106 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-22555d84-91b4-406b-af4e-810f8104a0c0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:15.580570 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:23:15.580979 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device f1a14498-e7d4-44ae-93dc-80ee1a0bcd2a not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:23:15.581615 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device a93a01da-484d-42e3-931f-f6e697d1abd5 no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:23:15.594310 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-22555d84-91b4-406b-af4e-810f8104a0c0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:15.601112 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: a93a01da-484d-42e3-931f-f6e697d1abd5 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:23:15.601463 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device a93a01da-484d-42e3-931f-f6e697d1abd5 not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:23:15.601887 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 11e3c4be-b19e-49b8-91f8-93740d537aa6 no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:23:15.609556 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33961615-efc4-4393-9ab1-d64f400baef3 req-938195a7-78a1-49e7-9c62-78fbe1c0ff9e tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:15.611062 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-33961615-efc4-4393-9ab1-d64f400baef3 req-938195a7-78a1-49e7-9c62-78fbe1c0ff9e tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.10 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 945 time: 0.0565827 Nov 11 17:23:15.621956 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: 11e3c4be-b19e-49b8-91f8-93740d537aa6 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:23:15.622302 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 11e3c4be-b19e-49b8-91f8-93740d537aa6 not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:23:15.709583 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [req-33961615-efc4-4393-9ab1-d64f400baef3 req-3d585804-13e8-42af-9bf1-d65ea0556b17 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Deleting port 6ed3a30f-66e5-4020-8ad7-dd0c5806629e {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:23:15.709814 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-33961615-efc4-4393-9ab1-d64f400baef3 req-3d585804-13e8-42af-9bf1-d65ea0556b17 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:15.721713 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-22555d84-91b4-406b-af4e-810f8104a0c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:15.724429 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-22555d84-91b4-406b-af4e-810f8104a0c0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:15.725641 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-22555d84-91b4-406b-af4e-810f8104a0c0 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/7f8e0c9e-8eed-476e-83d2-a5e717672c24 HTTP/1.1" status: 204 len: 168 time: 0.2054656 Nov 11 17:23:15.734313 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22555d84-91b4-406b-af4e-810f8104a0c0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f8e0c9e-8eed-476e-83d2-a5e717672c24,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:15.806940 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-33961615-efc4-4393-9ab1-d64f400baef3 req-3d585804-13e8-42af-9bf1-d65ea0556b17 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] For port 6ed3a30f-66e5-4020-8ad7-dd0c5806629e, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=6ed3a30f-66e5-4020-8ad7-dd0c5806629e,segment=NetworkSegment(753ecf25-f3e0-45e8-979a-6bf9fed6081c),segment_id=753ecf25-f3e0-45e8-979a-6bf9fed6081c)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:15.807294 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-33961615-efc4-4393-9ab1-d64f400baef3 req-3d585804-13e8-42af-9bf1-d65ea0556b17 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:15.821085 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [req-33961615-efc4-4393-9ab1-d64f400baef3 req-3d585804-13e8-42af-9bf1-d65ea0556b17 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Calling delete_port for 6ed3a30f-66e5-4020-8ad7-dd0c5806629e owned by compute:nova {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:23:16.048392 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-33961615-efc4-4393-9ab1-d64f400baef3 req-3d585804-13e8-42af-9bf1-d65ea0556b17 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:16.064595 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['6ed3a30f-66e5-4020-8ad7-dd0c5806629e'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:23:16.084048 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d585804-13e8-42af-9bf1-d65ea0556b17 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Pushing event deleted for resources: {'Port': ['ID=6ed3a30f-66e5-4020-8ad7-dd0c5806629e,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:16.128065 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [req-33961615-efc4-4393-9ab1-d64f400baef3 req-3d585804-13e8-42af-9bf1-d65ea0556b17 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] No DVR routers for this DVR port 6ed3a30f-66e5-4020-8ad7-dd0c5806629e on host hv-cinder-69414 {{(pid=102323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:23:16.130802 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-33961615-efc4-4393-9ab1-d64f400baef3 req-3d585804-13e8-42af-9bf1-d65ea0556b17 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:16.134490 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-33961615-efc4-4393-9ab1-d64f400baef3 req-3d585804-13e8-42af-9bf1-d65ea0556b17 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.10 "DELETE /v2.0/ports/6ed3a30f-66e5-4020-8ad7-dd0c5806629e HTTP/1.1" status: 204 len: 173 time: 0.5137360 Nov 11 17:23:16.134985 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'da42bcbe-103c-4803-90d1-114e7f617141', 'name': 'network-vif-deleted', 'tag': '6ed3a30f-66e5-4020-8ad7-dd0c5806629e'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:23:16.137411 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d5591f21-6bc7-4944-84b3-3bc9a4117051" -d '{"events": [{"server_uuid": "da42bcbe-103c-4803-90d1-114e7f617141", "name": "network-vif-deleted", "tag": "6ed3a30f-66e5-4020-8ad7-dd0c5806629e"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:23:16.183285 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:23:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-991df43d-7626-4c0b-be31-548d107c12a4 x-openstack-request-id: req-991df43d-7626-4c0b-be31-548d107c12a4 {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:23:16.183580 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "da42bcbe-103c-4803-90d1-114e7f617141", "name": "network-vif-deleted", "tag": "6ed3a30f-66e5-4020-8ad7-dd0c5806629e", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:23:16.184052 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-991df43d-7626-4c0b-be31-548d107c12a4 {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:23:16.184340 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'da42bcbe-103c-4803-90d1-114e7f617141', 'name': 'network-vif-deleted', 'tag': '6ed3a30f-66e5-4020-8ad7-dd0c5806629e', 'status': 'completed', 'code': 200} Nov 11 17:23:16.519901 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-22ec65a6-648f-4be3-83a1-78405899a35a req-c6bcf30c-d20a-46f4-a460-ab3091af1280 tempest-VolumesActionsTest-2118973496 tempest-VolumesActionsTest-2118973496-project] 10.222.0.16 "GET /v2.0/ports?device_id=da42bcbe-103c-4803-90d1-114e7f617141 HTTP/1.1" status: 200 len: 210 time: 0.0262761 Nov 11 17:23:16.770107 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 36390) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:16.879865 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-48288688-e880-4412-a13b-3f2feb4b45b3 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1885448476-network', 'tenant_id': 'c02f323bd05c4d6bbbadfb2cf91bd62d'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:23:16.909997 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a784379f-aecc-4a8b-add2-fd14cc768858 req-234dbd0b-2cd6-4e95-8a87-605c781bffa0 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0406885 Nov 11 17:23:16.955912 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:17.001692 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a784379f-aecc-4a8b-add2-fd14cc768858 req-79ac3189-43de-4f8f-b43c-4643e7e8277a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:17.003220 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a784379f-aecc-4a8b-add2-fd14cc768858 req-79ac3189-43de-4f8f-b43c-4643e7e8277a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 1098 time: 0.0433834 Nov 11 17:23:17.018383 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-48288688-e880-4412-a13b-3f2feb4b45b3 admin admin] Made reservation on behalf of c02f323bd05c4d6bbbadfb2cf91bd62d for: {'network': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:23:17.020689 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-48288688-e880-4412-a13b-3f2feb4b45b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:17.029256 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-48288688-e880-4412-a13b-3f2feb4b45b3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:17.112510 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-48288688-e880-4412-a13b-3f2feb4b45b3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:17.132153 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:23:17.184926 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-48288688-e880-4412-a13b-3f2feb4b45b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:17.211358 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-48288688-e880-4412-a13b-3f2feb4b45b3 admin admin] vlan segment allocate from pool success with {'vlan_id': 515, 'physical_network': 'physnet1'} {{(pid=102324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:23:17.221084 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48288688-e880-4412-a13b-3f2feb4b45b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=528ee871-45ec-4320-80d8-ae5c846539a7,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:17.229514 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-48288688-e880-4412-a13b-3f2feb4b45b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:17.229679 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.segments_db [None req-48288688-e880-4412-a13b-3f2feb4b45b3 admin admin] Added segment 173487ed-3830-4fbf-b2c1-18f1333338b7 of type vlan for network 0d49ad27-76fe-421c-86d6-138a53bc5d1c Nov 11 17:23:17.272574 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-48288688-e880-4412-a13b-3f2feb4b45b3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:17.355711 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-48288688-e880-4412-a13b-3f2feb4b45b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:17.356680 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48288688-e880-4412-a13b-3f2feb4b45b3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:17.357310 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-48288688-e880-4412-a13b-3f2feb4b45b3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:17.378259 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a784379f-aecc-4a8b-add2-fd14cc768858 req-39f5b26f-1ae9-4df4-a88f-b8bd448c9a30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:17.379703 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a784379f-aecc-4a8b-add2-fd14cc768858 req-39f5b26f-1ae9-4df4-a88f-b8bd448c9a30 service neutron] 10.222.0.10 "GET /v2.0/networks?id=45e6626a-2007-490b-a445-d7c3baea689e HTTP/1.1" status: 200 len: 912 time: 0.3530147 Nov 11 17:23:17.414302 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48288688-e880-4412-a13b-3f2feb4b45b3 admin admin] Pushing event updated for resources: {'Network': ['ID=0d49ad27-76fe-421c-86d6-138a53bc5d1c,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:17.424594 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network 0d49ad27-76fe-421c-86d6-138a53bc5d1c details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:23:17.456020 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a784379f-aecc-4a8b-add2-fd14cc768858 req-a7277401-b3b9-48db-9132-f9a86ac6f213 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5d28ea1f-ba26-4f7e-93e2-89690070a29f HTTP/1.1" status: 200 len: 1001 time: 0.0641489 Nov 11 17:23:17.456728 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-48288688-e880-4412-a13b-3f2feb4b45b3 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.6851711 Nov 11 17:23:17.459424 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 36394) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:17.464783 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-de259dab-0db3-4b67-ac22-67b9154c26b1 admin admin] Request body: {'subnet': {'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1885448476-subnet', 'tenant_id': 'c02f323bd05c4d6bbbadfb2cf91bd62d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:23:17.510196 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a784379f-aecc-4a8b-add2-fd14cc768858 req-4f4affe1-574d-4e9d-8cc9-b27b217f1666 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:17.511622 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a784379f-aecc-4a8b-add2-fd14cc768858 req-4f4affe1-574d-4e9d-8cc9-b27b217f1666 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=bf78c82f-f2f3-4ef7-8052-be816dbd2df8 HTTP/1.1" status: 200 len: 850 time: 0.0456748 Nov 11 17:23:17.563931 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a784379f-aecc-4a8b-add2-fd14cc768858 req-16aff816-1732-469a-bd3d-031bc6ed3333 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:17.565453 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a784379f-aecc-4a8b-add2-fd14cc768858 req-16aff816-1732-469a-bd3d-031bc6ed3333 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=45e6626a-2007-490b-a445-d7c3baea689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0431395 Nov 11 17:23:17.567411 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-de259dab-0db3-4b67-ac22-67b9154c26b1 admin admin] Made reservation on behalf of c02f323bd05c4d6bbbadfb2cf91bd62d for: {'subnet': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:23:17.569983 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-de259dab-0db3-4b67-ac22-67b9154c26b1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5275488'] for subnet, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:17.682034 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a784379f-aecc-4a8b-add2-fd14cc768858 req-46c670d7-046e-417d-b8ed-0bf298bf7523 service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1024485 Nov 11 17:23:17.776774 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a784379f-aecc-4a8b-add2-fd14cc768858 req-635bf43c-0dc5-4c51-a450-004ceb73b1f3 service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0878277 Nov 11 17:23:17.836134 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-de259dab-0db3-4b67-ac22-67b9154c26b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5436401', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5275470'] for subnet, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:17.899997 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de259dab-0db3-4b67-ac22-67b9154c26b1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=92bc39c3-f62a-4a09-b809-9f253b9c7487,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:17.909069 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de259dab-0db3-4b67-ac22-67b9154c26b1 admin admin] Checking segment: {'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:23:17.909069 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de259dab-0db3-4b67-ac22-67b9154c26b1 admin admin] Network hostable DHCP agents. Network: 0d49ad27-76fe-421c-86d6-138a53bc5d1c, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:23:18.063887 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de259dab-0db3-4b67-ac22-67b9154c26b1 admin admin] Network 0d49ad27-76fe-421c-86d6-138a53bc5d1c is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:23:18.178834 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-de259dab-0db3-4b67-ac22-67b9154c26b1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, 0d49ad27-76fe-421c-86d6-138a53bc5d1c) {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:23:18.183225 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de259dab-0db3-4b67-ac22-67b9154c26b1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:18.183830 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-de259dab-0db3-4b67-ac22-67b9154c26b1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:18.188298 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f150146a-a05c-42b3-89b8-dd185013957c None None] Network 0d49ad27-76fe-421c-86d6-138a53bc5d1c requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:23:18.320020 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0c280d4-ddfa-497f-8138-cf73984255f4 None None] Network 0d49ad27-76fe-421c-86d6-138a53bc5d1c requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:23:18.325077 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-de259dab-0db3-4b67-ac22-67b9154c26b1 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.8642409 Nov 11 17:23:18.759129 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69324765-3211-4c1c-80d7-dbff320ab639 req-49768e5e-5b62-4cc3-934e-7cf55f3318bc tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:18.885674 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-69324765-3211-4c1c-80d7-dbff320ab639 req-49768e5e-5b62-4cc3-934e-7cf55f3318bc tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/networks?id=0d49ad27-76fe-421c-86d6-138a53bc5d1c HTTP/1.1" status: 200 len: 815 time: 0.1048315 Nov 11 17:23:18.885674 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-69324765-3211-4c1c-80d7-dbff320ab639 req-7f5863f6-5df0-49e9-9487-ae1642b034a1 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/quotas/c02f323bd05c4d6bbbadfb2cf91bd62d HTTP/1.1" status: 200 len: 375 time: 0.0116615 Nov 11 17:23:18.885674 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-69324765-3211-4c1c-80d7-dbff320ab639 req-9a430bc0-6142-4ef9-8345-c72ff2c266c3 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=c02f323bd05c4d6bbbadfb2cf91bd62d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0372450 Nov 11 17:23:18.918362 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-69324765-3211-4c1c-80d7-dbff320ab639 req-dac4cea2-9571-4635-9cd1-67651a0e4574 service neutron] 10.222.0.16 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868049 Nov 11 17:23:19.014044 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-69324765-3211-4c1c-80d7-dbff320ab639 req-9bf0e238-99c1-4b2c-9a91-8543121c0ace service neutron] 10.222.0.16 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0894763 Nov 11 17:23:19.261569 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-203a2094-24de-4842-b2da-65ec6cecb8f1 req-92652561-0830-434d-99a1-5b9aa8d0983f tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 210 time: 0.0262072 Nov 11 17:23:20.355460 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-be9864a1-27ce-46ee-b87c-2fa652ad1f0a req-0fb7f0ee-8b11-48ff-84c0-bdd14d604952 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 210 time: 0.0263987 Nov 11 17:23:21.219568 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 6ed3a30f-66e5-4020-8ad7-dd0c5806629e no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:23:21.244882 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: 6ed3a30f-66e5-4020-8ad7-dd0c5806629e {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:23:21.249653 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 6ed3a30f-66e5-4020-8ad7-dd0c5806629e not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:23:21.454936 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-625160f5-da28-4945-8f86-378b7ea4daa4 req-bf8b863f-c209-47c7-831d-33f1f6f51de1 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 210 time: 0.0320630 Nov 11 17:23:22.546662 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c7dbec1b-90dd-4612-a9ea-a759da23b1c1 req-b2941bb6-40ba-4ec2-bae2-a803b942280d tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 210 time: 0.0263162 Nov 11 17:23:23.426843 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69324765-3211-4c1c-80d7-dbff320ab639 req-cfa6a725-1209-4bbe-a84b-5452f54b9f54 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:23.428272 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-69324765-3211-4c1c-80d7-dbff320ab639 req-cfa6a725-1209-4bbe-a84b-5452f54b9f54 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.10 "GET /v2.0/networks?id=0d49ad27-76fe-421c-86d6-138a53bc5d1c HTTP/1.1" status: 200 len: 815 time: 0.1040573 Nov 11 17:23:23.441685 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-69324765-3211-4c1c-80d7-dbff320ab639 req-8f1a0cce-e510-440b-8073-43226129673c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Request body: {'port': {'device_id': 'c1d80c3c-a50f-4ee9-8d8a-84bd9920d108', 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c', 'admin_state_up': True, 'tenant_id': 'c02f323bd05c4d6bbbadfb2cf91bd62d'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:23:23.645083 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f804e61a-3f15-47ba-b33d-78fd18945f09 req-a5fd6cca-467d-4f50-af6c-ff63a7c5fb35 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 210 time: 0.0285652 Nov 11 17:23:23.645933 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-69324765-3211-4c1c-80d7-dbff320ab639 req-8f1a0cce-e510-440b-8073-43226129673c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Made reservation on behalf of c02f323bd05c4d6bbbadfb2cf91bd62d for: {'port': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:23:23.649351 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-69324765-3211-4c1c-80d7-dbff320ab639 req-8f1a0cce-e510-440b-8073-43226129673c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:23.779261 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [req-69324765-3211-4c1c-80d7-dbff320ab639 req-8f1a0cce-e510-440b-8073-43226129673c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Allocated IP 172.20.0.10 (0d49ad27-76fe-421c-86d6-138a53bc5d1c/92bc39c3-f62a-4a09-b809-9f253b9c7487/70e42819-0a8f-45db-bd4b-b7af772f04ec) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:23:23.941966 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-69324765-3211-4c1c-80d7-dbff320ab639 req-8f1a0cce-e510-440b-8073-43226129673c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:24.047734 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-69324765-3211-4c1c-80d7-dbff320ab639 req-8f1a0cce-e510-440b-8073-43226129673c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:24.090559 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-69324765-3211-4c1c-80d7-dbff320ab639 req-8f1a0cce-e510-440b-8073-43226129673c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Network 0d49ad27-76fe-421c-86d6-138a53bc5d1c is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:23:24.097694 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [req-69324765-3211-4c1c-80d7-dbff320ab639 req-8f1a0cce-e510-440b-8073-43226129673c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:23:24.100386 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [req-69324765-3211-4c1c-80d7-dbff320ab639 req-8f1a0cce-e510-440b-8073-43226129673c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:23:24.135586 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f1a0cce-e510-440b-8073-43226129673c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Pushing event updated for resources: {'Port': ['ID=70e42819-0a8f-45db-bd4b-b7af772f04ec,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:24.162508 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69324765-3211-4c1c-80d7-dbff320ab639 req-8f1a0cce-e510-440b-8073-43226129673c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:24.163496 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-69324765-3211-4c1c-80d7-dbff320ab639 req-8f1a0cce-e510-440b-8073-43226129673c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:24.262123 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-69324765-3211-4c1c-80d7-dbff320ab639 req-8f1a0cce-e510-440b-8073-43226129673c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8241465 Nov 11 17:23:24.275666 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Request body: {'port': {'device_id': 'c1d80c3c-a50f-4ee9-8d8a-84bd9920d108', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:23:24.334917 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:24.648328 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 70e42819-0a8f-45db-bd4b-b7af772f04ec {{(pid=102323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:23:24.657089 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:24.684671 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.provisioning_blocks [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Transition to ACTIVE for port object 70e42819-0a8f-45db-bd4b-b7af772f04ec will not be triggered until provisioned by entity L2. {{(pid=102323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:23:24.772205 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:24.838449 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab125bf7-f6da-4fbd-88b0-59489f2d2be7 req-9bec1f63-c00e-4820-bc62-b6ba168f0d02 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:24.842297 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ab125bf7-f6da-4fbd-88b0-59489f2d2be7 req-9bec1f63-c00e-4820-bc62-b6ba168f0d02 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 932 time: 0.0965037 Nov 11 17:23:24.847947 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Pushing event updated for resources: {'Port': ['ID=70e42819-0a8f-45db-bd4b-b7af772f04ec,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:24.919390 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ab125bf7-f6da-4fbd-88b0-59489f2d2be7 req-25f55ba7-6af4-43d4-91e4-abd7d723827e tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0696266 Nov 11 17:23:24.922410 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Attempting to bind port 70e42819-0a8f-45db-bd4b-b7af772f04ec on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:23:24.922805 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Attempting to bind port 70e42819-0a8f-45db-bd4b-b7af772f04ec by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:23:24.923141 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Attempting to bind port 70e42819-0a8f-45db-bd4b-b7af772f04ec on network 0d49ad27-76fe-421c-86d6-138a53bc5d1c {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:23:24.934883 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Port 70e42819-0a8f-45db-bd4b-b7af772f04ec on network 0d49ad27-76fe-421c-86d6-138a53bc5d1c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:23:24.935228 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Attempting to bind port 70e42819-0a8f-45db-bd4b-b7af772f04ec on network 0d49ad27-76fe-421c-86d6-138a53bc5d1c {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:23:24.941028 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 23, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:23:24.941379 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Checking segment: {'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:23:24.941740 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Bound using segment: {'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:23:24.942165 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Bound port: 70e42819-0a8f-45db-bd4b-b7af772f04ec, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'}}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:23:24.942526 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:25.013236 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] For port 70e42819-0a8f-45db-bd4b-b7af772f04ec, host hv-cinder-69414, cleared binding levels {{(pid=102323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:23:25.021935 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] For port 70e42819-0a8f-45db-bd4b-b7af772f04ec, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=70e42819-0a8f-45db-bd4b-b7af772f04ec,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:23:25.116303 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:25.168036 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:25.168664 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:25.170280 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-69324765-3211-4c1c-80d7-dbff320ab639 req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] 10.222.0.10 "PUT /v2.0/ports/70e42819-0a8f-45db-bd4b-b7af772f04ec HTTP/1.1" status: 200 len: 1094 time: 0.8991616 Nov 11 17:23:25.170895 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c1d80c3c-a50f-4ee9-8d8a-84bd9920d108', 'tag': '70e42819-0a8f-45db-bd4b-b7af772f04ec'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:23:25.175808 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd79b1dc-cf06-431a-b9dc-c374e950c8d4" -d '{"events": [{"name": "network-changed", "server_uuid": "c1d80c3c-a50f-4ee9-8d8a-84bd9920d108", "tag": "70e42819-0a8f-45db-bd4b-b7af772f04ec"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:23:25.201066 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d98f06bb-53df-44ac-be05-1c3c932e933c service neutron] Pushing event updated for resources: {'Port': ['ID=70e42819-0a8f-45db-bd4b-b7af772f04ec,revision_number=3']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:25.252395 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:23:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4baaa570-7134-4e30-8184-aac24929ae21 x-openstack-request-id: req-4baaa570-7134-4e30-8184-aac24929ae21 {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:23:25.255425 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c1d80c3c-a50f-4ee9-8d8a-84bd9920d108", "tag": "70e42819-0a8f-45db-bd4b-b7af772f04ec", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:23:25.255425 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-4baaa570-7134-4e30-8184-aac24929ae21 {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:23:25.255425 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c1d80c3c-a50f-4ee9-8d8a-84bd9920d108', 'tag': '70e42819-0a8f-45db-bd4b-b7af772f04ec', 'status': 'completed', 'code': 200} Nov 11 17:23:25.318170 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69324765-3211-4c1c-80d7-dbff320ab639 req-2657c475-447a-4414-9c5b-dcfeaf8a7d1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:25.319782 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-69324765-3211-4c1c-80d7-dbff320ab639 req-2657c475-447a-4414-9c5b-dcfeaf8a7d1e service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=c02f323bd05c4d6bbbadfb2cf91bd62d&device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 1097 time: 0.0464244 Nov 11 17:23:25.369119 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-69324765-3211-4c1c-80d7-dbff320ab639 req-e02f06e5-0910-4875-bada-52e683110637 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=70e42819-0a8f-45db-bd4b-b7af772f04ec HTTP/1.1" status: 200 len: 217 time: 0.0412314 Nov 11 17:23:25.426312 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69324765-3211-4c1c-80d7-dbff320ab639 req-5feb50ee-a5bb-43c4-81eb-c8130e2b4d1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:25.427932 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-69324765-3211-4c1c-80d7-dbff320ab639 req-5feb50ee-a5bb-43c4-81eb-c8130e2b4d1a service neutron] 10.222.0.10 "GET /v2.0/subnets?id=92bc39c3-f62a-4a09-b809-9f253b9c7487 HTTP/1.1" status: 200 len: 855 time: 0.0489404 Nov 11 17:23:25.463718 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-69324765-3211-4c1c-80d7-dbff320ab639 req-de81991b-936c-4706-9b70-9a2696c9aff5 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=0d49ad27-76fe-421c-86d6-138a53bc5d1c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0281596 Nov 11 17:23:25.581787 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-69324765-3211-4c1c-80d7-dbff320ab639 req-db70ae4b-0902-4611-9db5-81f609e297e2 service neutron] 10.222.0.10 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1096992 Nov 11 17:23:25.687887 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-69324765-3211-4c1c-80d7-dbff320ab639 req-c1eef073-14a4-4600-93eb-a994836a939c service neutron] 10.222.0.10 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0978284 Nov 11 17:23:25.880113 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd79b1dc-cf06-431a-b9dc-c374e950c8d4 req-a1c67f2e-a644-4ec6-bd66-52b1fe565479 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:25.881938 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-dd79b1dc-cf06-431a-b9dc-c374e950c8d4 req-a1c67f2e-a644-4ec6-bd66-52b1fe565479 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=c02f323bd05c4d6bbbadfb2cf91bd62d&device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 1097 time: 0.0648685 Nov 11 17:23:25.988498 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd79b1dc-cf06-431a-b9dc-c374e950c8d4 req-be9856de-e930-46b6-92c5-48becd738f4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:25.990212 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-dd79b1dc-cf06-431a-b9dc-c374e950c8d4 req-be9856de-e930-46b6-92c5-48becd738f4d service neutron] 10.222.0.10 "GET /v2.0/networks?id=0d49ad27-76fe-421c-86d6-138a53bc5d1c HTTP/1.1" status: 200 len: 916 time: 0.1002483 Nov 11 17:23:26.046786 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-dd79b1dc-cf06-431a-b9dc-c374e950c8d4 req-772d5b52-691a-4351-a399-472a891165ae service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=70e42819-0a8f-45db-bd4b-b7af772f04ec HTTP/1.1" status: 200 len: 217 time: 0.0454493 Nov 11 17:23:26.057371 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5059124b-bff4-4eda-8454-a124ee3da3c6 req-d57d8aed-d75c-41cc-b849-ae59b656bede tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:26.059827 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5059124b-bff4-4eda-8454-a124ee3da3c6 req-d57d8aed-d75c-41cc-b849-ae59b656bede tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 944 time: 0.0608003 Nov 11 17:23:26.106389 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd79b1dc-cf06-431a-b9dc-c374e950c8d4 req-b322c018-9339-4f2a-b7d2-beb4859791ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:26.110595 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-dd79b1dc-cf06-431a-b9dc-c374e950c8d4 req-b322c018-9339-4f2a-b7d2-beb4859791ef service neutron] 10.222.0.10 "GET /v2.0/subnets?id=92bc39c3-f62a-4a09-b809-9f253b9c7487 HTTP/1.1" status: 200 len: 855 time: 0.0542896 Nov 11 17:23:26.137497 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5059124b-bff4-4eda-8454-a124ee3da3c6 req-a98c8abe-a4d2-4dd0-b30d-ffe7d622ef93 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620091 Nov 11 17:23:26.151923 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-dd79b1dc-cf06-431a-b9dc-c374e950c8d4 req-3a56f599-015c-4dc7-b23e-7e97bd080d88 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=0d49ad27-76fe-421c-86d6-138a53bc5d1c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0352461 Nov 11 17:23:26.284473 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-dd79b1dc-cf06-431a-b9dc-c374e950c8d4 req-2e7e48f7-1c9a-4d95-94a8-4c7eaf80f679 service neutron] 10.222.0.10 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1220372 Nov 11 17:23:26.397170 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-dd79b1dc-cf06-431a-b9dc-c374e950c8d4 req-57ed0ba8-e624-4150-bc4b-6adbe0681675 service neutron] 10.222.0.10 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1047387 Nov 11 17:23:27.259991 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db83846c-35d4-4a34-af12-2ecca2b1bc0b req-f19de7ec-ea72-4e66-9971-713f85b0f15e tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:27.261552 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-db83846c-35d4-4a34-af12-2ecca2b1bc0b req-f19de7ec-ea72-4e66-9971-713f85b0f15e tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 944 time: 0.0519924 Nov 11 17:23:27.327910 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-db83846c-35d4-4a34-af12-2ecca2b1bc0b req-7b6143e7-f188-4a5e-a055-7d2d5d369ed3 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0573013 Nov 11 17:23:28.472876 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a4dc15d-22a4-4ddf-9d2c-a377f34db8a0 req-5197c5b2-56ba-44a3-a378-cdc1eae994c5 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:28.474300 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7a4dc15d-22a4-4ddf-9d2c-a377f34db8a0 req-5197c5b2-56ba-44a3-a378-cdc1eae994c5 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 944 time: 0.0618744 Nov 11 17:23:28.525856 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7a4dc15d-22a4-4ddf-9d2c-a377f34db8a0 req-6ac1bd00-7d8c-48ca-84ac-9add34239e5f tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448654 Nov 11 17:23:29.659510 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8905437d-05d9-4c2e-83d3-2373e500fa81 req-a3ab3319-76ff-4a82-8e56-fc9eb0244f3b tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:29.661140 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8905437d-05d9-4c2e-83d3-2373e500fa81 req-a3ab3319-76ff-4a82-8e56-fc9eb0244f3b tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 944 time: 0.0531151 Nov 11 17:23:29.711338 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8905437d-05d9-4c2e-83d3-2373e500fa81 req-8a638f6e-650a-4f62-8845-ad2e1a6b3077 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433741 Nov 11 17:23:30.278237 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 70e42819-0a8f-45db-bd4b-b7af772f04ec details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:23:30.383273 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 70e42819-0a8f-45db-bd4b-b7af772f04ec, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=70e42819-0a8f-45db-bd4b-b7af772f04ec,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:30.406004 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '70e42819-0a8f-45db-bd4b-b7af772f04ec', 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c', 'port_id': '70e42819-0a8f-45db-bd4b-b7af772f04ec', 'mac_address': 'fa:16:3e:7b:d0:a5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 515, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '92bc39c3-f62a-4a09-b809-9f253b9c7487', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:23:30.441389 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:30.458537 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 70e42819-0a8f-45db-bd4b-b7af772f04ec {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:23:30.485657 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 70e42819-0a8f-45db-bd4b-b7af772f04ec, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=70e42819-0a8f-45db-bd4b-b7af772f04ec,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:30.556380 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:30.621377 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=70e42819-0a8f-45db-bd4b-b7af772f04ec,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:30.803586 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['70e42819-0a8f-45db-bd4b-b7af772f04ec'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:23:30.844313 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5b4bdeb-cbd4-413b-a3b1-2e0b9cb08eab req-ff9c8f8a-332e-42f1-bc92-8d49afdd6741 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:30.854588 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f5b4bdeb-cbd4-413b-a3b1-2e0b9cb08eab req-ff9c8f8a-332e-42f1-bc92-8d49afdd6741 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 945 time: 0.0667527 Nov 11 17:23:30.920953 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f5b4bdeb-cbd4-413b-a3b1-2e0b9cb08eab req-f6d8f612-c7f7-4a3a-a36c-fe92c9761bf3 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0650709 Nov 11 17:23:30.973449 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4f3012dc-d83b-452c-ba7f-5a7f46cde59d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:32.054578 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06515f56-3930-4f9d-88e1-6e3a41d85515 req-6bb78bfb-9031-43b1-9dfe-d02e4b17f286 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:32.059089 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-06515f56-3930-4f9d-88e1-6e3a41d85515 req-6bb78bfb-9031-43b1-9dfe-d02e4b17f286 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 945 time: 0.0701435 Nov 11 17:23:32.134622 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-06515f56-3930-4f9d-88e1-6e3a41d85515 req-5fad92f1-4aa5-4702-ad97-8b1bf16d4ff1 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0678747 Nov 11 17:23:32.291530 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 70e42819-0a8f-45db-bd4b-b7af772f04ec up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:23:32.423409 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port 70e42819-0a8f-45db-bd4b-b7af772f04ec completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:23:32.428018 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 70e42819-0a8f-45db-bd4b-b7af772f04ec triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:32.428390 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:32.528436 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:32.555515 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c1d80c3c-a50f-4ee9-8d8a-84bd9920d108', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '70e42819-0a8f-45db-bd4b-b7af772f04ec'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:23:32.558448 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b7d45b76-c4b5-4320-8293-501760426175" -d '{"events": [{"server_uuid": "c1d80c3c-a50f-4ee9-8d8a-84bd9920d108", "name": "network-vif-plugged", "status": "completed", "tag": "70e42819-0a8f-45db-bd4b-b7af772f04ec"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:23:32.572522 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 70e42819-0a8f-45db-bd4b-b7af772f04ec, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=70e42819-0a8f-45db-bd4b-b7af772f04ec,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:32.613620 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:23:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-689c2b3f-31ae-4176-848b-70fc2c537531 x-openstack-request-id: req-689c2b3f-31ae-4176-848b-70fc2c537531 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:23:32.613620 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c1d80c3c-a50f-4ee9-8d8a-84bd9920d108", "name": "network-vif-plugged", "status": "completed", "tag": "70e42819-0a8f-45db-bd4b-b7af772f04ec", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:23:32.613620 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-689c2b3f-31ae-4176-848b-70fc2c537531 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:23:32.613620 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c1d80c3c-a50f-4ee9-8d8a-84bd9920d108', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '70e42819-0a8f-45db-bd4b-b7af772f04ec', 'code': 200} Nov 11 17:23:32.642454 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:32.733886 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=70e42819-0a8f-45db-bd4b-b7af772f04ec,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:33.167953 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863bca41-0d37-470c-990f-9c675219f0ff req-6d48869d-5d43-4acd-9598-35708e7aa650 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:33.169457 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-863bca41-0d37-470c-990f-9c675219f0ff req-6d48869d-5d43-4acd-9598-35708e7aa650 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 1099 time: 0.0494833 Nov 11 17:23:33.248740 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-863bca41-0d37-470c-990f-9c675219f0ff req-97afde3a-19f0-415d-a662-61c4df573a12 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0675261 Nov 11 17:23:33.275906 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-623f54d6-57a5-44cc-ac37-7c13c30cf9fd req-4ce95f83-3c96-41c0-bed9-241105f8365c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:33.277771 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-623f54d6-57a5-44cc-ac37-7c13c30cf9fd req-4ce95f83-3c96-41c0-bed9-241105f8365c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 946 time: 0.0717647 Nov 11 17:23:33.335548 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-623f54d6-57a5-44cc-ac37-7c13c30cf9fd req-2ef7f112-6c4c-4034-af8c-ac9b0aa1e897 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511608 Nov 11 17:23:33.543495 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-522af4ad-1042-4dd2-a12f-675ef2bd8262 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:34.515086 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0a1c81a-5a12-4858-b387-a065586a7e2b req-eddd821c-20f5-4b19-a12b-4343af8a3d81 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:34.517855 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e0a1c81a-5a12-4858-b387-a065586a7e2b req-eddd821c-20f5-4b19-a12b-4343af8a3d81 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 946 time: 0.0851738 Nov 11 17:23:34.595121 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e0a1c81a-5a12-4858-b387-a065586a7e2b req-2f4c588d-2eaf-48ea-b46a-a1fce88167e2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0622084 Nov 11 17:23:34.612407 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:35.720214 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36e13f2d-d678-4b8c-ad43-c2fc3f1a4298 req-cc184c0c-146c-4d0e-9bb2-e4433817dd78 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:35.721716 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-36e13f2d-d678-4b8c-ad43-c2fc3f1a4298 req-cc184c0c-146c-4d0e-9bb2-e4433817dd78 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 946 time: 0.0524421 Nov 11 17:23:35.777470 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-36e13f2d-d678-4b8c-ad43-c2fc3f1a4298 req-d725e813-bfd5-4baa-b273-73c12c9bef40 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492837 Nov 11 17:23:36.354570 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:36.983340 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:44.000167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 36722) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:44.042655 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_v2 [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Deleting subnet d68553ee-3443-497b-8d4d-d6a614d8ae12 {{(pid=102324) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:23:44.045647 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:44.080527 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5895837'] for subnet, precommit_delete_associations {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:44.118533 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:44.228668 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5436208', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5275461'] for subnet, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:44.255706 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d68553ee-3443-497b-8d4d-d6a614d8ae12,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:44.261934 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:44.265114 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/d68553ee-3443-497b-8d4d-d6a614d8ae12 HTTP/1.1" status: 204 len: 168 time: 0.2639346 Nov 11 17:23:44.267696 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36724) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:44.270019 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.270475 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.270836 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.271167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.271491 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.271816 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.272505 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.272839 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.273784 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.274101 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.274417 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.274756 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2158c758-a1dd-460f-91d3-75769c1889e5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.337072 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:44.416588 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:44.436104 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6ef38ec7-2801-48d8-a258-bd68f4aeffc2']}} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:44.446114 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '753ecf25-f3e0-45e8-979a-6bf9fed6081c') {'for_net_delete': True} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:44.446401 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '753ecf25-f3e0-45e8-979a-6bf9fed6081c') {} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:44.455636 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5777070'] for segment, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:44.469615 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:44.476633 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Releasing vlan 519 on physical network physnet1 to pool {{(pid=102323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:23:44.476886 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5720605'] for segment, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: Traceback (most recent call last): Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: timer() Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: cb(*args, **kw) Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: return func(*args, **kwargs) Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: self._notify() Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: self.callback(batched_events) Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: event.method(event) Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: return f(self, *a, **k) Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._get(url).json() Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: return self.request(url, 'GET', **kwargs) Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:23:44.478891 dv-cinder-694140-2-iscsi neutron-server[102323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:23:44.611412 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:44.617256 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:44.621983 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] 10.222.0.16 "DELETE /v2.0/networks/6ef38ec7-2801-48d8-a258-bd68f4aeffc2 HTTP/1.1" status: 204 len: 168 time: 0.3516586 Nov 11 17:23:44.634723 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Pushing event deleted for resources: {'Network': ['ID=6ef38ec7-2801-48d8-a258-bd68f4aeffc2,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:44.642043 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.642350 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.642608 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.642940 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.643272 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.643599 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.643923 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.644245 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.644571 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.644898 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.645305 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.645623 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b987163-1f5e-4987-8718-e6dced269246 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:44.878323 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36730) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:44.921241 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-801697bd-5d2d-4379-acd8-ac0bdace99f4 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=cda486fa48ba43ef850a91d2cc5fca1d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0416398 Nov 11 17:23:44.923585 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36732) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:44.977228 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b2bad173-a471-4db1-9be1-d808a1aabab6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:45.003946 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b2bad173-a471-4db1-9be1-d808a1aabab6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:45.130408 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b2bad173-a471-4db1-9be1-d808a1aabab6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:45.132915 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b2bad173-a471-4db1-9be1-d808a1aabab6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:45.134065 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-b2bad173-a471-4db1-9be1-d808a1aabab6 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/f54f1415-3005-4d30-9cbd-6a9342486bb3 HTTP/1.1" status: 204 len: 168 time: 0.2095692 Nov 11 17:23:45.142198 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2bad173-a471-4db1-9be1-d808a1aabab6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f54f1415-3005-4d30-9cbd-6a9342486bb3,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:46.154324 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6fa20da-84c3-431c-859d-48da1862654b req-d28cb85d-2ef6-4822-9a62-035f4f5bb196 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:46.155877 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f6fa20da-84c3-431c-859d-48da1862654b req-d28cb85d-2ef6-4822-9a62-035f4f5bb196 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/networks?id=0d49ad27-76fe-421c-86d6-138a53bc5d1c HTTP/1.1" status: 200 len: 815 time: 0.1078727 Nov 11 17:23:46.176786 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f6fa20da-84c3-431c-859d-48da1862654b req-999ca803-4f94-42aa-82b2-b42d45be136c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/quotas/c02f323bd05c4d6bbbadfb2cf91bd62d HTTP/1.1" status: 200 len: 375 time: 0.0097260 Nov 11 17:23:46.193728 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 36770) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:46.236271 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f6fa20da-84c3-431c-859d-48da1862654b req-d33074d0-3798-4575-9190-24519346a1ac tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=c02f323bd05c4d6bbbadfb2cf91bd62d&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0521681 Nov 11 17:23:46.297243 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-98da1606-94fa-4950-bc8f-a93a005b6dac admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1336680617-network', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:23:46.365424 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-98da1606-94fa-4950-bc8f-a93a005b6dac admin admin] Made reservation on behalf of 53c4ca7574da4b2a868a39a52a98e620 for: {'network': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:23:46.367977 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-98da1606-94fa-4950-bc8f-a93a005b6dac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:46.376889 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-98da1606-94fa-4950-bc8f-a93a005b6dac admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:46.421485 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f6fa20da-84c3-431c-859d-48da1862654b req-70193d89-ee81-411d-91b3-de94018cb149 service neutron] 10.222.0.16 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1779902 Nov 11 17:23:46.477271 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-98da1606-94fa-4950-bc8f-a93a005b6dac admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:46.519437 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f6fa20da-84c3-431c-859d-48da1862654b req-6900a762-2d60-499a-9b4f-b33d7af88eff service neutron] 10.222.0.16 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0912290 Nov 11 17:23:46.537193 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-98da1606-94fa-4950-bc8f-a93a005b6dac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:46.564417 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-98da1606-94fa-4950-bc8f-a93a005b6dac admin admin] vlan segment allocate from pool success with {'vlan_id': 548, 'physical_network': 'physnet1'} {{(pid=102324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:23:46.573342 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98da1606-94fa-4950-bc8f-a93a005b6dac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eab779ed-63d2-410a-8554-56ccc0c5f358,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:46.579310 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-98da1606-94fa-4950-bc8f-a93a005b6dac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:46.579610 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.segments_db [None req-98da1606-94fa-4950-bc8f-a93a005b6dac admin admin] Added segment 84e8dda5-3747-4e23-984b-1e3957701cfb of type vlan for network e1e04a10-fb62-4a0a-a705-82de35b80b1b Nov 11 17:23:46.623305 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-98da1606-94fa-4950-bc8f-a93a005b6dac admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:46.735115 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-98da1606-94fa-4950-bc8f-a93a005b6dac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:46.736023 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98da1606-94fa-4950-bc8f-a93a005b6dac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:46.742769 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-98da1606-94fa-4950-bc8f-a93a005b6dac admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:46.755437 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3a650828-0310-49e3-a3ba-aa53c25dc7e3 req-9e0eb133-2fde-4bf2-a0e9-c569a84ce42c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 210 time: 0.0305736 Nov 11 17:23:46.815213 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98da1606-94fa-4950-bc8f-a93a005b6dac admin admin] Pushing event updated for resources: {'Network': ['ID=e1e04a10-fb62-4a0a-a705-82de35b80b1b,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:46.826450 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network e1e04a10-fb62-4a0a-a705-82de35b80b1b details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:23:46.846368 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36784) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:46.851865 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-98da1606-94fa-4950-bc8f-a93a005b6dac admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.6551521 Nov 11 17:23:46.855343 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-33169b6c-1f4f-4ae7-9196-38eb1d648583 admin admin] Request body: {'subnet': {'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1336680617-subnet', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'ip_version': 4}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:23:46.953953 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:46.954362 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-33169b6c-1f4f-4ae7-9196-38eb1d648583 admin admin] Made reservation on behalf of 53c4ca7574da4b2a868a39a52a98e620 for: {'subnet': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:23:46.956955 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-33169b6c-1f4f-4ae7-9196-38eb1d648583 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5388291'] for subnet, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:47.182603 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-33169b6c-1f4f-4ae7-9196-38eb1d648583 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5720706', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5388333'] for subnet, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:47.242405 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33169b6c-1f4f-4ae7-9196-38eb1d648583 admin admin] Pushing event updated for resources: {'Subnet': ['ID=45e5a299-340d-4f14-b0eb-66727a394b7c,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:47.250768 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33169b6c-1f4f-4ae7-9196-38eb1d648583 admin admin] Checking segment: {'id': '84e8dda5-3747-4e23-984b-1e3957701cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 548, 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:23:47.251131 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33169b6c-1f4f-4ae7-9196-38eb1d648583 admin admin] Network hostable DHCP agents. Network: e1e04a10-fb62-4a0a-a705-82de35b80b1b, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102323) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:23:47.336681 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33169b6c-1f4f-4ae7-9196-38eb1d648583 admin admin] Network e1e04a10-fb62-4a0a-a705-82de35b80b1b is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102323) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:23:47.422606 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-33169b6c-1f4f-4ae7-9196-38eb1d648583 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, e1e04a10-fb62-4a0a-a705-82de35b80b1b) {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:23:47.426751 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33169b6c-1f4f-4ae7-9196-38eb1d648583 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:47.427342 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-33169b6c-1f4f-4ae7-9196-38eb1d648583 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:47.432404 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7f45b65-44a5-40e6-8c23-148b01affe57 None None] Network e1e04a10-fb62-4a0a-a705-82de35b80b1b requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:23:47.545392 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-33169b6c-1f4f-4ae7-9196-38eb1d648583 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6977656 Nov 11 17:23:47.548029 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36788) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:47.554606 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1336680617-router', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:23:47.584022 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaac6311d-333a-5f5f-a33c-91960009c34a-e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'fixed_ips': [{'subnet_id': '45e5a299-340d-4f14-b0eb-66727a394b7c'}]}} from dv-cinder-694140-2-iscsi. {{(pid=102325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 17:23:47.584937 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:47.680687 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-424378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7339'] for router, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:47.682283 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-424390', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-397156', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7867629', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7328'] for router, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:47.721873 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.db_base_plugin_common [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Allocated IP 172.20.0.2 (e1e04a10-fb62-4a0a-a705-82de35b80b1b/45e5a299-340d-4f14-b0eb-66727a394b7c/d1ed592c-d33b-407d-b4c7-99da73461b7b) {{(pid=102325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:23:47.736986 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:47.868843 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Publish callbacks [] for port, precommit_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:47.887130 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-cc49d852-7e64-4aea-bb9d-a5085af697cf req-927e05cf-3031-48a6-a553-5cea5ea3bc76 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 210 time: 0.0552409 Nov 11 17:23:47.931758 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624'] for port, after_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:47.956862 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:47.973128 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Network e1e04a10-fb62-4a0a-a705-82de35b80b1b is already hosted by enough agents. {{(pid=102325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:23:47.976570 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.base_scheduler [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Resources bound (agent type, host, resource id): {{(pid=102325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:23:47.979399 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Received port after_create {{(pid=102325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:23:47.988177 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Pushing event updated for resources: {'Port': ['ID=d1ed592c-d33b-407d-b4c7-99da73461b7b,revision_number=1']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:48.039534 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Attempting to bind port d1ed592c-d33b-407d-b4c7-99da73461b7b on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:23:48.040188 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Attempting to bind port d1ed592c-d33b-407d-b4c7-99da73461b7b by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '84e8dda5-3747-4e23-984b-1e3957701cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 548, 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:23:48.040627 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Attempting to bind port d1ed592c-d33b-407d-b4c7-99da73461b7b on network e1e04a10-fb62-4a0a-a705-82de35b80b1b {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:23:48.046302 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 23, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:23:48.046700 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Checking segment: {'id': '84e8dda5-3747-4e23-984b-1e3957701cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 548, 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:23:48.047100 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:48.047490 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Bound using segment: {'id': '84e8dda5-3747-4e23-984b-1e3957701cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 548, 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:23:48.047963 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Bound port: d1ed592c-d33b-407d-b4c7-99da73461b7b, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '84e8dda5-3747-4e23-984b-1e3957701cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 548, 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:23:48.048371 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:48.118518 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] For port d1ed592c-d33b-407d-b4c7-99da73461b7b, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:23:48.121894 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] For port d1ed592c-d33b-407d-b4c7-99da73461b7b, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=d1ed592c-d33b-407d-b4c7-99da73461b7b,segment=NetworkSegment(84e8dda5-3747-4e23-984b-1e3957701cfb),segment_id=84e8dda5-3747-4e23-984b-1e3957701cfb)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:23:48.195375 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:48.214166 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:48.233658 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:48.263137 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d8ccc5-6a45-4770-b0f5-16bc4981d2ac None None] Pushing event updated for resources: {'Port': ['ID=d1ed592c-d33b-407d-b4c7-99da73461b7b,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:48.345796 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Allocated IP 172.27.1.13 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/312d3448-1034-4dc3-8ce7-a0402912f35d) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:23:48.469404 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:48.588315 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:48.668783 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:23:48.677151 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:23:48.679787 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:23:48.709057 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Pushing event updated for resources: {'Port': ['ID=312d3448-1034-4dc3-8ce7-a0402912f35d,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:48.746111 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6fa20da-84c3-431c-859d-48da1862654b req-be17f6d6-c7f3-4d8b-937b-fc3b22d813e3 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:48.746111 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f6fa20da-84c3-431c-859d-48da1862654b req-be17f6d6-c7f3-4d8b-937b-fc3b22d813e3 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.10 "GET /v2.0/networks?id=0d49ad27-76fe-421c-86d6-138a53bc5d1c HTTP/1.1" status: 200 len: 815 time: 0.1884942 Nov 11 17:23:48.787262 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-f6fa20da-84c3-431c-859d-48da1862654b req-fa6e9133-60f9-4438-a5f8-425dc3efe043 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Request body: {'port': {'device_id': 'd4ee3379-5ccf-431e-8f53-6626b9a4b498', 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c', 'admin_state_up': True, 'tenant_id': 'c02f323bd05c4d6bbbadfb2cf91bd62d'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:23:48.999115 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7c882384-1f9f-41d6-aa46-5af2fcfe56a1 req-6cd1497c-bc9a-4c1d-9cf4-2a1640114766 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 210 time: 0.0327229 Nov 11 17:23:49.138361 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-893e55e1-0ce0-40c7-84d5-cd406b933233 None None] Network e1e04a10-fb62-4a0a-a705-82de35b80b1b requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:23:49.255666 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-a351be5d-860f-4885-93f2-8f1c2be898b1 None None] Provisioning complete for port d1ed592c-d33b-407d-b4c7-99da73461b7b triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:49.255951 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-a351be5d-860f-4885-93f2-8f1c2be898b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:49.294674 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f6fa20da-84c3-431c-859d-48da1862654b req-fa6e9133-60f9-4438-a5f8-425dc3efe043 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Made reservation on behalf of c02f323bd05c4d6bbbadfb2cf91bd62d for: {'port': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:23:49.298738 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-f6fa20da-84c3-431c-859d-48da1862654b req-fa6e9133-60f9-4438-a5f8-425dc3efe043 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:49.372209 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-a351be5d-860f-4885-93f2-8f1c2be898b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:49.410324 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-a351be5d-860f-4885-93f2-8f1c2be898b1 None None] For port d1ed592c-d33b-407d-b4c7-99da73461b7b, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=d1ed592c-d33b-407d-b4c7-99da73461b7b,segment=NetworkSegment(84e8dda5-3747-4e23-984b-1e3957701cfb),segment_id=84e8dda5-3747-4e23-984b-1e3957701cfb)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:49.438304 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:49.469267 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-a351be5d-860f-4885-93f2-8f1c2be898b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:49.522617 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a351be5d-860f-4885-93f2-8f1c2be898b1 None None] Pushing event updated for resources: {'Port': ['ID=d1ed592c-d33b-407d-b4c7-99da73461b7b,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:49.566084 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [req-f6fa20da-84c3-431c-859d-48da1862654b req-fa6e9133-60f9-4438-a5f8-425dc3efe043 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Allocated IP 172.20.0.3 (0d49ad27-76fe-421c-86d6-138a53bc5d1c/92bc39c3-f62a-4a09-b809-9f253b9c7487/6176c69f-e97f-44c0-93d8-bad69dcaac9c) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:23:49.594883 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-07c4249f-7cb7-470b-bb0f-74f06a323518 None None] Provisioning complete for port d1ed592c-d33b-407d-b4c7-99da73461b7b triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:49.595259 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-07c4249f-7cb7-470b-bb0f-74f06a323518 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:49.645838 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device d1ed592c-d33b-407d-b4c7-99da73461b7b up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:23:49.730306 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port d1ed592c-d33b-407d-b4c7-99da73461b7b triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:49.730703 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:49.771364 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 36798) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:49.791105 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-424501', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-397235'] for router, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:49.866092 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-f6fa20da-84c3-431c-859d-48da1862654b req-fa6e9133-60f9-4438-a5f8-425dc3efe043 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:49.934163 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-a9186d66-9e34-489d-97a3-0b700e8f551b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Deleting port 8e1eef75-6ce5-43d5-a1e3-462135870861 {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:23:49.934500 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a9186d66-9e34-489d-97a3-0b700e8f551b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:50.005414 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-f6fa20da-84c3-431c-859d-48da1862654b req-fa6e9133-60f9-4438-a5f8-425dc3efe043 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:50.012248 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a9186d66-9e34-489d-97a3-0b700e8f551b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:50.018525 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a9186d66-9e34-489d-97a3-0b700e8f551b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:50.018990 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['70e42819-0a8f-45db-bd4b-b7af772f04ec'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:23:50.030813 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-a9186d66-9e34-489d-97a3-0b700e8f551b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Calling delete_port for 8e1eef75-6ce5-43d5-a1e3-462135870861 owned by network:floatingip {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:23:50.041958 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Router fbdb60a9-d48f-44d5-a652-95278f391d51 is scheduled to L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 with binding_index 1 {{(pid=102323) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 17:23:50.051664 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f6fa20da-84c3-431c-859d-48da1862654b req-fa6e9133-60f9-4438-a5f8-425dc3efe043 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Network 0d49ad27-76fe-421c-86d6-138a53bc5d1c is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:23:50.067614 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [req-f6fa20da-84c3-431c-859d-48da1862654b req-fa6e9133-60f9-4438-a5f8-425dc3efe043 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:23:50.067614 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [req-f6fa20da-84c3-431c-859d-48da1862654b req-fa6e9133-60f9-4438-a5f8-425dc3efe043 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:23:50.096946 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa6e9133-60f9-4438-a5f8-425dc3efe043 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Pushing event updated for resources: {'Port': ['ID=6176c69f-e97f-44c0-93d8-bad69dcaac9c,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:50.201703 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6fa20da-84c3-431c-859d-48da1862654b req-fa6e9133-60f9-4438-a5f8-425dc3efe043 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:50.204966 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-f6fa20da-84c3-431c-859d-48da1862654b req-fa6e9133-60f9-4438-a5f8-425dc3efe043 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:50.256130 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-102a47e3-e213-47f2-8e2b-a1c78058e7fd req-d7b42adb-c387-4513-8a18-973ef5ee0b51 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:50.258182 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-102a47e3-e213-47f2-8e2b-a1c78058e7fd req-d7b42adb-c387-4513-8a18-973ef5ee0b51 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 931 time: 0.1637840 Nov 11 17:23:50.275595 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:23:50.284743 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Sync routers for ids ['fbdb60a9-d48f-44d5-a652-95278f391d51'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:23:50.294663 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Routers {'fbdb60a9-d48f-44d5-a652-95278f391d51'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:23:50.314529 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:23:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['fbdb60a9-d48f-44d5-a652-95278f391d51'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:50.323822 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-102a47e3-e213-47f2-8e2b-a1c78058e7fd req-e82b0a5b-4c87-4973-ae98-3aa1a0063fee tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0581377 Nov 11 17:23:50.325829 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a9186d66-9e34-489d-97a3-0b700e8f551b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:50.349078 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f6fa20da-84c3-431c-859d-48da1862654b req-fa6e9133-60f9-4438-a5f8-425dc3efe043 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5659077 Nov 11 17:23:50.365080 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Request body: {'port': {'device_id': 'd4ee3379-5ccf-431e-8f53-6626b9a4b498', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:23:50.388755 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] Publish callbacks [] for router, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:50.392928 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-a60350a9-9f66-4773-81a2-20f3c3e6889f admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 2.8410864 Nov 11 17:23:50.393186 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36802) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:50.481924 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:50.544856 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Set router fbdb60a9-d48f-44d5-a652-95278f391d51 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:23:50.633575 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9186d66-9e34-489d-97a3-0b700e8f551b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event deleted for resources: {'Port': ['ID=8e1eef75-6ce5-43d5-a1e3-462135870861,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:50.701543 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a9186d66-9e34-489d-97a3-0b700e8f551b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for floatingip, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:50.702275 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.l3_db [None req-a9186d66-9e34-489d-97a3-0b700e8f551b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Floating IP 143f1b78-c826-4036-b24a-434913f42ef9 disassociated (deleted). External IP: 172.27.1.228, port: 18cd1277-d6d0-48b5-bbbc-c0b112fe275f. Nov 11 17:23:50.733023 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'name': 'tempest-TestShelveInstance-1336680617-router', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13'}], 'enable_snat': True}, 'gw_port_id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:47Z', 'updated_at': '2021-11-11T17:23:49Z', 'revision_number': 3, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'gw_port': {'id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:48:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:48Z', 'updated_at': '2021-11-11T17:23:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:50.764802 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Checking router: fbdb60a9-d48f-44d5-a652-95278f391d51 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:23:50.765152 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Updating router fbdb60a9-d48f-44d5-a652-95278f391d51 port 312d3448-1034-4dc3-8ce7-a0402912f35d binding host dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:23:50.791202 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:50.926025 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a9186d66-9e34-489d-97a3-0b700e8f551b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Router 1267b92b-e259-4df2-9704-b862470a9e03 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:23:50.978108 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6176c69f-e97f-44c0-93d8-bad69dcaac9c {{(pid=102323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:23:50.988758 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:51.028367 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.provisioning_blocks [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Transition to ACTIVE for port object 6176c69f-e97f-44c0-93d8-bad69dcaac9c will not be triggered until provisioned by entity L2. {{(pid=102323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:23:51.050770 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a9186d66-9e34-489d-97a3-0b700e8f551b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:23:51.054091 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Publish callbacks [] for port, precommit_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:51.055553 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a9186d66-9e34-489d-97a3-0b700e8f551b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:51.060526 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ea643e9-43cd-43f8-9571-bd2409038df4 None None] Sync routers for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:23:51.070263 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ea643e9-43cd-43f8-9571-bd2409038df4 None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:23:51.071021 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-4ea643e9-43cd-43f8-9571-bd2409038df4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:23:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:51.087747 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:51.090844 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-a9186d66-9e34-489d-97a3-0b700e8f551b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "DELETE /v2.0/floatingips/143f1b78-c826-4036-b24a-434913f42ef9 HTTP/1.1" status: 204 len: 168 time: 1.3175979 Nov 11 17:23:51.091372 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7d756663-1f8a-4181-884f-ba0ae9a11772', 'tag': '18cd1277-d6d0-48b5-bbbc-c0b112fe275f'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:23:51.093648 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-13140f57-77a8-4cf3-bcbd-1cccba88802d" -d '{"events": [{"name": "network-changed", "server_uuid": "7d756663-1f8a-4181-884f-ba0ae9a11772", "tag": "18cd1277-d6d0-48b5-bbbc-c0b112fe275f"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:23:51.130814 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:51.165664 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:23:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e3bcbe80-b1c1-408d-ac87-fdc673461f1f x-openstack-request-id: req-e3bcbe80-b1c1-408d-ac87-fdc673461f1f {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:23:51.165953 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7d756663-1f8a-4181-884f-ba0ae9a11772", "tag": "18cd1277-d6d0-48b5-bbbc-c0b112fe275f", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:23:51.166204 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-e3bcbe80-b1c1-408d-ac87-fdc673461f1f {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:23:51.166682 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7d756663-1f8a-4181-884f-ba0ae9a11772', 'tag': '18cd1277-d6d0-48b5-bbbc-c0b112fe275f', 'status': 'completed', 'code': 200} Nov 11 17:23:51.174156 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:51.207355 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Attempting to bind port 312d3448-1034-4dc3-8ce7-a0402912f35d on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:23:51.208886 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Attempting to bind port 312d3448-1034-4dc3-8ce7-a0402912f35d by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:23:51.210843 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Attempting to bind port 312d3448-1034-4dc3-8ce7-a0402912f35d on network 78b17769-6fae-453e-8ae3-4a72e72bccfc {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:23:51.219657 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e904bad-6d35-4f0e-b479-71394e70f8ae None None] Pushing event updated for resources: {'Port': ['ID=312d3448-1034-4dc3-8ce7-a0402912f35d,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:51.220857 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-4ea643e9-43cd-43f8-9571-bd2409038df4 None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:23:51.222146 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 23, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:23:51.222661 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Checking segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:23:51.223151 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:51.223633 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Bound using segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:23:51.224934 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Bound port: 312d3448-1034-4dc3-8ce7-a0402912f35d, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:23:51.224934 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:51.240634 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13140f57-77a8-4cf3-bcbd-1cccba88802d req-c1f33ae1-25f9-4737-9812-e5c613027cb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:51.246980 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-13140f57-77a8-4cf3-bcbd-1cccba88802d req-c1f33ae1-25f9-4737-9812-e5c613027cb8 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 1099 time: 0.0717866 Nov 11 17:23:51.281592 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Pushing event updated for resources: {'Port': ['ID=6176c69f-e97f-44c0-93d8-bad69dcaac9c,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:51.291546 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] For port 312d3448-1034-4dc3-8ce7-a0402912f35d, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:23:51.296064 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] For port 312d3448-1034-4dc3-8ce7-a0402912f35d, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=312d3448-1034-4dc3-8ce7-a0402912f35d,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:23:51.299631 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e904bad-6d35-4f0e-b479-71394e70f8ae None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:51.300247 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e904bad-6d35-4f0e-b479-71394e70f8ae None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:51.300803 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e904bad-6d35-4f0e-b479-71394e70f8ae None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:51.301160 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e904bad-6d35-4f0e-b479-71394e70f8ae None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:51.301471 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e904bad-6d35-4f0e-b479-71394e70f8ae None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:51.301805 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e904bad-6d35-4f0e-b479-71394e70f8ae None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:51.302130 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e904bad-6d35-4f0e-b479-71394e70f8ae None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:51.302454 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e904bad-6d35-4f0e-b479-71394e70f8ae None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:51.302816 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e904bad-6d35-4f0e-b479-71394e70f8ae None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:51.303133 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e904bad-6d35-4f0e-b479-71394e70f8ae None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:51.303451 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e904bad-6d35-4f0e-b479-71394e70f8ae None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:51.303771 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e904bad-6d35-4f0e-b479-71394e70f8ae None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:51.361898 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13140f57-77a8-4cf3-bcbd-1cccba88802d req-6c70b5ec-efa7-4092-8326-27e8883d7be4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:51.362776 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:51.365767 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-13140f57-77a8-4cf3-bcbd-1cccba88802d req-6c70b5ec-efa7-4092-8326-27e8883d7be4 service neutron] 10.222.0.10 "GET /v2.0/networks?id=45e6626a-2007-490b-a445-d7c3baea689e HTTP/1.1" status: 200 len: 912 time: 0.1145470 Nov 11 17:23:51.389823 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Attempting to bind port 6176c69f-e97f-44c0-93d8-bad69dcaac9c on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:23:51.390622 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Attempting to bind port 6176c69f-e97f-44c0-93d8-bad69dcaac9c by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:23:51.390622 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Attempting to bind port 6176c69f-e97f-44c0-93d8-bad69dcaac9c on network 0d49ad27-76fe-421c-86d6-138a53bc5d1c {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:23:51.402590 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Port 6176c69f-e97f-44c0-93d8-bad69dcaac9c on network 0d49ad27-76fe-421c-86d6-138a53bc5d1c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:23:51.403006 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Attempting to bind port 6176c69f-e97f-44c0-93d8-bad69dcaac9c on network 0d49ad27-76fe-421c-86d6-138a53bc5d1c {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:23:51.407795 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Allocated IP 172.20.0.1 (e1e04a10-fb62-4a0a-a705-82de35b80b1b/45e5a299-340d-4f14-b0eb-66727a394b7c/27767633-1ab7-44d5-890c-4a3c38c807f6) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:23:51.413830 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 23, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:23:51.414165 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Checking segment: {'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:23:51.414607 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Bound using segment: {'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'} {{(pid=102323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:23:51.415041 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.managers [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Bound port: 6176c69f-e97f-44c0-93d8-bad69dcaac9c, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'}}] {{(pid=102323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:23:51.415394 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:51.419329 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-13140f57-77a8-4cf3-bcbd-1cccba88802d req-fac025af-6b6a-4255-9c1f-e22f2715f6ae service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=18cd1277-d6d0-48b5-bbbc-c0b112fe275f HTTP/1.1" status: 200 len: 217 time: 0.0454721 Nov 11 17:23:51.475033 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Routers {'fbdb60a9-d48f-44d5-a652-95278f391d51'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:23:51.475680 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:23:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['fbdb60a9-d48f-44d5-a652-95278f391d51'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:51.477574 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e904bad-6d35-4f0e-b479-71394e70f8ae None None] Pushing event updated for resources: {'Port': ['ID=312d3448-1034-4dc3-8ce7-a0402912f35d,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:51.536497 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13140f57-77a8-4cf3-bcbd-1cccba88802d req-7eb54d5c-2427-4576-86cb-0b0bb8ceb0a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:51.539042 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-13140f57-77a8-4cf3-bcbd-1cccba88802d req-7eb54d5c-2427-4576-86cb-0b0bb8ceb0a4 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=bf78c82f-f2f3-4ef7-8052-be816dbd2df8 HTTP/1.1" status: 200 len: 850 time: 0.1087742 Nov 11 17:23:51.580217 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] For port 6176c69f-e97f-44c0-93d8-bad69dcaac9c, host hv-cinder-69414, cleared binding levels {{(pid=102323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:23:51.609221 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] For port 6176c69f-e97f-44c0-93d8-bad69dcaac9c, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=6176c69f-e97f-44c0-93d8-bad69dcaac9c,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:23:51.625718 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13140f57-77a8-4cf3-bcbd-1cccba88802d req-abb133c7-2d91-440e-8059-fbeea7f150b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:51.627423 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-13140f57-77a8-4cf3-bcbd-1cccba88802d req-abb133c7-2d91-440e-8059-fbeea7f150b1 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=45e6626a-2007-490b-a445-d7c3baea689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0793526 Nov 11 17:23:51.643501 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4179968-ab65-46d5-b2c5-0e85f5e277f9 req-98ab3ade-ddd3-48c8-9e03-e39e5dc1c78f tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:51.648396 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d4179968-ab65-46d5-b2c5-0e85f5e277f9 req-98ab3ade-ddd3-48c8-9e03-e39e5dc1c78f tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 943 time: 0.1396854 Nov 11 17:23:51.652831 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device d1ed592c-d33b-407d-b4c7-99da73461b7b up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:23:51.674057 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-4ea643e9-43cd-43f8-9571-bd2409038df4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '98da0cbf-ec1c-4c72-a17d-c2c96671021e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'floating_ip_address': '172.27.1.133', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'port_id': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 542, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'mac_address': 'fa:16:3e:b6:db:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:20:09Z', 'updated_at': '2021-11-11T17:20:12Z', 'revision_number': 1, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:51.690575 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] Set router fbdb60a9-d48f-44d5-a652-95278f391d51 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:23:51.712578 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ea643e9-43cd-43f8-9571-bd2409038df4 None None] Checking router: 1267b92b-e259-4df2-9704-b862470a9e03 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:23:51.724325 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ea643e9-43cd-43f8-9571-bd2409038df4 None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:23:51.725029 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-4ea643e9-43cd-43f8-9571-bd2409038df4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:23:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:51.735882 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-414a01a1-8231-4346-b068-6850dd70ec19 req-9bbc0c88-0123-4b83-82a4-c8c3415deafc tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:51.737734 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-414a01a1-8231-4346-b068-6850dd70ec19 req-9bbc0c88-0123-4b83-82a4-c8c3415deafc tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 946 time: 0.1490922 Nov 11 17:23:51.814212 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-13140f57-77a8-4cf3-bcbd-1cccba88802d req-7a67bb8b-4c62-4d9f-9b21-8c4d6992c9be service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1707249 Nov 11 17:23:51.820840 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-414a01a1-8231-4346-b068-6850dd70ec19 req-764e5985-0d7a-4671-aa9a-e90e6861af75 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0732186 Nov 11 17:23:51.846128 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port d1ed592c-d33b-407d-b4c7-99da73461b7b triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:51.846717 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:51.897023 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-4ea643e9-43cd-43f8-9571-bd2409038df4 None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:23:51.938117 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-13140f57-77a8-4cf3-bcbd-1cccba88802d req-32f7bc5f-9f3c-4846-bac9-a63636dfd0d2 service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1153870 Nov 11 17:23:51.978353 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:51.997333 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:52.015552 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'name': 'tempest-TestShelveInstance-1336680617-router', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13'}], 'enable_snat': True}, 'gw_port_id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:47Z', 'updated_at': '2021-11-11T17:23:49Z', 'revision_number': 3, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'gw_port': {'id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:48:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:48Z', 'updated_at': '2021-11-11T17:23:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:52.035607 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:52.036380 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:52.037887 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f6fa20da-84c3-431c-859d-48da1862654b req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] 10.222.0.10 "PUT /v2.0/ports/6176c69f-e97f-44c0-93d8-bad69dcaac9c HTTP/1.1" status: 200 len: 1093 time: 1.6774132 Nov 11 17:23:52.040373 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd4ee3379-5ccf-431e-8f53-6626b9a4b498', 'tag': '6176c69f-e97f-44c0-93d8-bad69dcaac9c'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:23:52.042991 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-31fb2a35-0ec0-4eaa-86f9-bcd397947375" -d '{"events": [{"name": "network-changed", "server_uuid": "d4ee3379-5ccf-431e-8f53-6626b9a4b498", "tag": "6176c69f-e97f-44c0-93d8-bad69dcaac9c"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:23:52.050187 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fcca203-d14c-41e2-a1fd-6568e66a4a3a None None] The sync data for ids ['fbdb60a9-d48f-44d5-a652-95278f391d51'] in dv-cinder-694140-2-iscsi is: [{'id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'name': 'tempest-TestShelveInstance-1336680617-router', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13'}], 'enable_snat': True}, 'gw_port_id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:47Z', 'updated_at': '2021-11-11T17:23:49Z', 'revision_number': 3, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'gw_port': {'id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:48:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:48Z', 'updated_at': '2021-11-11T17:23:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:23:52.091455 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:23:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6ba2598f-008a-4be1-85c4-1a2183c71f0e x-openstack-request-id: req-6ba2598f-008a-4be1-85c4-1a2183c71f0e {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:23:52.100713 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d4ee3379-5ccf-431e-8f53-6626b9a4b498", "tag": "6176c69f-e97f-44c0-93d8-bad69dcaac9c", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:23:52.100713 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-6ba2598f-008a-4be1-85c4-1a2183c71f0e {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:23:52.100713 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd4ee3379-5ccf-431e-8f53-6626b9a4b498', 'tag': '6176c69f-e97f-44c0-93d8-bad69dcaac9c', 'status': 'completed', 'code': 200} Nov 11 17:23:52.112076 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d4179968-ab65-46d5-b2c5-0e85f5e277f9 req-ab49d9b9-a334-425d-91f1-d181752d7935 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4587839 Nov 11 17:23:52.142949 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8c6272a-27ed-4a3f-887d-cf29e905beba service neutron] Pushing event updated for resources: {'Port': ['ID=6176c69f-e97f-44c0-93d8-bad69dcaac9c,revision_number=3']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:52.177859 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31fb2a35-0ec0-4eaa-86f9-bcd397947375 req-5b6b80bf-88bd-4b38-bd76-e0aee6f0601c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:52.179834 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-31fb2a35-0ec0-4eaa-86f9-bcd397947375 req-5b6b80bf-88bd-4b38-bd76-e0aee6f0601c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=c02f323bd05c4d6bbbadfb2cf91bd62d&device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 1096 time: 0.0571518 Nov 11 17:23:52.196781 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-4ea643e9-43cd-43f8-9571-bd2409038df4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '98da0cbf-ec1c-4c72-a17d-c2c96671021e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'floating_ip_address': '172.27.1.133', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'port_id': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 542, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'mac_address': 'fa:16:3e:b6:db:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:20:09Z', 'updated_at': '2021-11-11T17:20:12Z', 'revision_number': 1, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:52.225252 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ea643e9-43cd-43f8-9571-bd2409038df4 None None] The sync data for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi is: [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '98da0cbf-ec1c-4c72-a17d-c2c96671021e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'floating_ip_address': '172.27.1.133', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'port_id': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 542, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'mac_address': 'fa:16:3e:b6:db:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:20:09Z', 'updated_at': '2021-11-11T17:20:12Z', 'revision_number': 1, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:23:52.252476 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:52.312002 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Network e1e04a10-fb62-4a0a-a705-82de35b80b1b is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:23:52.317413 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:23:52.325249 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:23:52.332534 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Pushing event updated for resources: {'Port': ['ID=27767633-1ab7-44d5-890c-4a3c38c807f6,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:52.408378 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31fb2a35-0ec0-4eaa-86f9-bcd397947375 req-433dc156-a960-408d-b3ee-6defa9a42f19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:52.414219 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-31fb2a35-0ec0-4eaa-86f9-bcd397947375 req-433dc156-a960-408d-b3ee-6defa9a42f19 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=c02f323bd05c4d6bbbadfb2cf91bd62d&shared=False HTTP/1.1" status: 200 len: 916 time: 0.2206841 Nov 11 17:23:52.418687 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-394084'] for router_interface, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:52.601989 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fb73cd70-2404-45dd-bd44-448e73d7439e None None] Provisioning complete for port 27767633-1ab7-44d5-890c-4a3c38c807f6 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:52.603069 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fb73cd70-2404-45dd-bd44-448e73d7439e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:52.612321 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31fb2a35-0ec0-4eaa-86f9-bcd397947375 req-471d511c-1f11-4580-9c6c-8514db6cb52f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:52.616912 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-31fb2a35-0ec0-4eaa-86f9-bcd397947375 req-471d511c-1f11-4580-9c6c-8514db6cb52f service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1970813 Nov 11 17:23:52.629583 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf968f16-345e-41f2-a4c0-27139784974f None None] New status for floating IP 143f1b78-c826-4036-b24a-434913f42ef9: DOWN {{(pid=102325) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:23:52.701631 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fb73cd70-2404-45dd-bd44-448e73d7439e None None] Port 27767633-1ab7-44d5-890c-4a3c38c807f6 cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:23:52.719760 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6fa20da-84c3-431c-859d-48da1862654b req-45a068a1-7778-443c-b667-bf7864e3b944 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:52.721383 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f6fa20da-84c3-431c-859d-48da1862654b req-45a068a1-7778-443c-b667-bf7864e3b944 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=c02f323bd05c4d6bbbadfb2cf91bd62d&device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 1096 time: 0.0473399 Nov 11 17:23:52.784396 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f6fa20da-84c3-431c-859d-48da1862654b req-acc1802d-af72-4a16-acad-e9dc04879df6 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=6176c69f-e97f-44c0-93d8-bad69dcaac9c HTTP/1.1" status: 200 len: 217 time: 0.0434773 Nov 11 17:23:52.787047 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:52.878035 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6fa20da-84c3-431c-859d-48da1862654b req-5452cf1c-5ce1-4854-8733-a2d43bd0b20f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:52.879304 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f6fa20da-84c3-431c-859d-48da1862654b req-5452cf1c-5ce1-4854-8733-a2d43bd0b20f service neutron] 10.222.0.10 "GET /v2.0/subnets?id=92bc39c3-f62a-4a09-b809-9f253b9c7487 HTTP/1.1" status: 200 len: 855 time: 0.0832009 Nov 11 17:23:52.935059 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f6fa20da-84c3-431c-859d-48da1862654b req-56ac8c85-872a-4e34-b331-c834ec341e92 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=0d49ad27-76fe-421c-86d6-138a53bc5d1c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0372782 Nov 11 17:23:52.967057 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adce5e70-3c63-4959-bc6e-61f0d29dfc64 req-637917dc-1ed9-45bd-b411-e73b81df2233 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:52.968809 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-adce5e70-3c63-4959-bc6e-61f0d29dfc64 req-637917dc-1ed9-45bd-b411-e73b81df2233 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 946 time: 0.0555820 Nov 11 17:23:53.024238 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-adce5e70-3c63-4959-bc6e-61f0d29dfc64 req-ca0e0e78-e88f-4875-baae-9dbebff4b4f7 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495970 Nov 11 17:23:53.083309 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f6fa20da-84c3-431c-859d-48da1862654b req-44564c51-e51f-4997-a17e-d1d1a3895fe3 service neutron] 10.222.0.10 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1236079 Nov 11 17:23:53.095624 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:53.161967 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:53.265383 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f6fa20da-84c3-431c-859d-48da1862654b req-c3292f4f-a733-4436-aa5e-f17788c96571 service neutron] 10.222.0.10 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1717501 Nov 11 17:23:53.274579 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Pushing event updated for resources: {'Port': ['ID=27767633-1ab7-44d5-890c-4a3c38c807f6,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:53.278496 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8103788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-394224'] for router_interface, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:53.282080 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f17e3e58-b40e-4a18-97fd-18a82cad13a3 req-24bc75fe-a92d-4d39-86cf-3d5943d0c59d tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:53.283660 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f17e3e58-b40e-4a18-97fd-18a82cad13a3 req-24bc75fe-a92d-4d39-86cf-3d5943d0c59d tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.10 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 946 time: 0.0525713 Nov 11 17:23:53.317001 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-557203f5-6ea6-4c55-b487-0cbb6d318f72 req-ea6ea210-cd94-4058-811f-9874e2eee94b tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:53.318473 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-557203f5-6ea6-4c55-b487-0cbb6d318f72 req-ea6ea210-cd94-4058-811f-9874e2eee94b tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 943 time: 0.1254265 Nov 11 17:23:53.381659 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-f17e3e58-b40e-4a18-97fd-18a82cad13a3 req-0e3931a9-a119-45bb-b784-20e607618349 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Deleting port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:23:53.382086 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f17e3e58-b40e-4a18-97fd-18a82cad13a3 req-0e3931a9-a119-45bb-b784-20e607618349 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:53.418881 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-557203f5-6ea6-4c55-b487-0cbb6d318f72 req-b32e5522-08c6-4e44-89b9-b5ab7df1dab2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0685892 Nov 11 17:23:53.425861 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Network e1e04a10-fb62-4a0a-a705-82de35b80b1b is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:23:53.427486 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:23:53.492409 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-f17e3e58-b40e-4a18-97fd-18a82cad13a3 req-0e3931a9-a119-45bb-b784-20e607618349 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] For port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=18cd1277-d6d0-48b5-bbbc-c0b112fe275f,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:53.495484 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f17e3e58-b40e-4a18-97fd-18a82cad13a3 req-0e3931a9-a119-45bb-b784-20e607618349 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:53.507764 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-f17e3e58-b40e-4a18-97fd-18a82cad13a3 req-0e3931a9-a119-45bb-b784-20e607618349 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Calling delete_port for 18cd1277-d6d0-48b5-bbbc-c0b112fe275f owned by compute:nova {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:23:53.570910 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Router fbdb60a9-d48f-44d5-a652-95278f391d51 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:23:53.655186 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 312d3448-1034-4dc3-8ce7-a0402912f35d up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:23:53.710096 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:23:53.713367 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 312d3448-1034-4dc3-8ce7-a0402912f35d triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:53.713735 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:53.715759 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-38a06159-eecb-4713-b6c6-88123cf319a6 admin admin] 10.222.0.16 "PUT /v2.0/routers/fbdb60a9-d48f-44d5-a652-95278f391d51/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3216448 Nov 11 17:23:53.773134 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-684545fd-b650-4b1e-bfe4-70e80a899993 None None] Provisioning complete for port 27767633-1ab7-44d5-890c-4a3c38c807f6 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:53.773382 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-684545fd-b650-4b1e-bfe4-70e80a899993 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:53.777250 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f17e3e58-b40e-4a18-97fd-18a82cad13a3 req-0e3931a9-a119-45bb-b784-20e607618349 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:53.833968 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-684545fd-b650-4b1e-bfe4-70e80a899993 None None] Port 27767633-1ab7-44d5-890c-4a3c38c807f6 cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:23:53.847987 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e3931a9-a119-45bb-b784-20e607618349 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event deleted for resources: {'Port': ['ID=18cd1277-d6d0-48b5-bbbc-c0b112fe275f,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:53.858202 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:53.860663 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Sync routers for ids ['fbdb60a9-d48f-44d5-a652-95278f391d51'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:23:53.863473 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-f17e3e58-b40e-4a18-97fd-18a82cad13a3 req-0e3931a9-a119-45bb-b784-20e607618349 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] No DVR routers for this DVR port 18cd1277-d6d0-48b5-bbbc-c0b112fe275f on host hv-cinder-69414 {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:23:53.865835 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-f17e3e58-b40e-4a18-97fd-18a82cad13a3 req-0e3931a9-a119-45bb-b784-20e607618349 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:53.869297 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f17e3e58-b40e-4a18-97fd-18a82cad13a3 req-0e3931a9-a119-45bb-b784-20e607618349 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.10 "DELETE /v2.0/ports/18cd1277-d6d0-48b5-bbbc-c0b112fe275f HTTP/1.1" status: 204 len: 173 time: 0.5791528 Nov 11 17:23:53.869762 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7d756663-1f8a-4181-884f-ba0ae9a11772', 'name': 'network-vif-deleted', 'tag': '18cd1277-d6d0-48b5-bbbc-c0b112fe275f'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:23:53.872016 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4de49f79-33bd-4f10-839f-3a9751b9a046" -d '{"events": [{"server_uuid": "7d756663-1f8a-4181-884f-ba0ae9a11772", "name": "network-vif-deleted", "tag": "18cd1277-d6d0-48b5-bbbc-c0b112fe275f"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:23:53.873785 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Routers {'fbdb60a9-d48f-44d5-a652-95278f391d51'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:23:53.874714 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:23:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['fbdb60a9-d48f-44d5-a652-95278f391d51'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:53.886535 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] For port 312d3448-1034-4dc3-8ce7-a0402912f35d, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=312d3448-1034-4dc3-8ce7-a0402912f35d,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:53.909074 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:23:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-836bf320-a804-4003-ab54-d679586e2c25 x-openstack-request-id: req-836bf320-a804-4003-ab54-d679586e2c25 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:23:53.909374 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7d756663-1f8a-4181-884f-ba0ae9a11772", "name": "network-vif-deleted", "tag": "18cd1277-d6d0-48b5-bbbc-c0b112fe275f", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:23:53.909621 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-836bf320-a804-4003-ab54-d679586e2c25 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:23:53.910020 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7d756663-1f8a-4181-884f-ba0ae9a11772', 'name': 'network-vif-deleted', 'tag': '18cd1277-d6d0-48b5-bbbc-c0b112fe275f', 'status': 'completed', 'code': 200} Nov 11 17:23:53.993025 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Set router fbdb60a9-d48f-44d5-a652-95278f391d51 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:23:54.005316 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:54.056765 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Pushing event updated for resources: {'Port': ['ID=312d3448-1034-4dc3-8ce7-a0402912f35d,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:54.157995 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-56cb539a-c2a1-4755-8683-cf2bce524763 req-72905637-74e2-4cc4-b073-992234a9135c tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 210 time: 0.0543995 Nov 11 17:23:54.192867 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:23:54.332685 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'name': 'tempest-TestShelveInstance-1336680617-router', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13'}], 'enable_snat': True}, 'gw_port_id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:47Z', 'updated_at': '2021-11-11T17:23:52Z', 'revision_number': 4, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'gw_port': {'id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:48:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:48Z', 'updated_at': '2021-11-11T17:23:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '27767633-1ab7-44d5-890c-4a3c38c807f6', 'name': '', 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'mac_address': 'fa:16:3e:6a:e7:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:51Z', 'updated_at': '2021-11-11T17:23:52Z', 'revision_number': 2, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'subnets': [{'id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:54.364237 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Checking router: fbdb60a9-d48f-44d5-a652-95278f391d51 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:23:54.364585 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Updating router fbdb60a9-d48f-44d5-a652-95278f391d51 port 27767633-1ab7-44d5-890c-4a3c38c807f6 binding host dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:23:54.391240 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:54.559939 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f78e22fe-166b-4d73-a5a0-313ce7723d9c req-1e2dfbc3-1b6a-4b30-b62b-ab7da42ff4a8 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:54.561397 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f78e22fe-166b-4d73-a5a0-313ce7723d9c req-1e2dfbc3-1b6a-4b30-b62b-ab7da42ff4a8 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 943 time: 0.0640583 Nov 11 17:23:54.621874 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f78e22fe-166b-4d73-a5a0-313ce7723d9c req-31b6da0c-d435-46ef-9905-38e7569c3e82 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497587 Nov 11 17:23:54.631183 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 36838) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:54.636635 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-78426082-de12-478e-9173-c8ef1598f7ee admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-639218667-network', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:23:54.682894 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Publish callbacks [] for port, precommit_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:54.759144 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-78426082-de12-478e-9173-c8ef1598f7ee admin admin] Made reservation on behalf of 8095b1a7a6bf4328a88245aa063676bf for: {'network': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:23:54.761473 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-78426082-de12-478e-9173-c8ef1598f7ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:54.770517 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-78426082-de12-478e-9173-c8ef1598f7ee admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:54.776192 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:54.847797 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-78426082-de12-478e-9173-c8ef1598f7ee admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:54.850436 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d5e59ec-0e74-49ac-b458-0182ef35971f None None] Pushing event updated for resources: {'Port': ['ID=27767633-1ab7-44d5-890c-4a3c38c807f6,revision_number=3']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:54.874411 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d5e59ec-0e74-49ac-b458-0182ef35971f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:54.875098 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d5e59ec-0e74-49ac-b458-0182ef35971f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:54.875343 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d5e59ec-0e74-49ac-b458-0182ef35971f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:54.875498 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d5e59ec-0e74-49ac-b458-0182ef35971f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:54.875822 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d5e59ec-0e74-49ac-b458-0182ef35971f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:54.876146 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d5e59ec-0e74-49ac-b458-0182ef35971f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:54.876469 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d5e59ec-0e74-49ac-b458-0182ef35971f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:54.876795 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d5e59ec-0e74-49ac-b458-0182ef35971f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:54.877134 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d5e59ec-0e74-49ac-b458-0182ef35971f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:54.877456 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d5e59ec-0e74-49ac-b458-0182ef35971f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:54.877927 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d5e59ec-0e74-49ac-b458-0182ef35971f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:54.878120 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d5e59ec-0e74-49ac-b458-0182ef35971f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:23:54.898284 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Attempting to bind port 27767633-1ab7-44d5-890c-4a3c38c807f6 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:23:54.898746 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Attempting to bind port 27767633-1ab7-44d5-890c-4a3c38c807f6 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '84e8dda5-3747-4e23-984b-1e3957701cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 548, 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b'}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:23:54.899107 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Attempting to bind port 27767633-1ab7-44d5-890c-4a3c38c807f6 on network e1e04a10-fb62-4a0a-a705-82de35b80b1b {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:23:54.902137 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-78426082-de12-478e-9173-c8ef1598f7ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:54.908409 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 23, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:23:54.908853 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Checking segment: {'id': '84e8dda5-3747-4e23-984b-1e3957701cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 548, 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:23:54.909327 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:54.909761 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Bound using segment: {'id': '84e8dda5-3747-4e23-984b-1e3957701cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 548, 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b'} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:23:54.910303 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Bound port: 27767633-1ab7-44d5-890c-4a3c38c807f6, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '84e8dda5-3747-4e23-984b-1e3957701cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 548, 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b'}}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:23:54.911526 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:54.938470 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-78426082-de12-478e-9173-c8ef1598f7ee admin admin] vlan segment allocate from pool success with {'vlan_id': 545, 'physical_network': 'physnet1'} {{(pid=102324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:23:54.945639 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78426082-de12-478e-9173-c8ef1598f7ee admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f33c327e-aa2e-478d-8dbf-05ee6e24f1cb,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:54.953392 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-78426082-de12-478e-9173-c8ef1598f7ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:54.953392 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.segments_db [None req-78426082-de12-478e-9173-c8ef1598f7ee admin admin] Added segment 110e841e-0526-4369-97dd-11f0bc420155 of type vlan for network 42706a37-4e5e-4c27-977c-73e50e8cd1d2 Nov 11 17:23:55.002296 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-78426082-de12-478e-9173-c8ef1598f7ee admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:55.004958 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] For port 27767633-1ab7-44d5-890c-4a3c38c807f6, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:23:55.010475 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] For port 27767633-1ab7-44d5-890c-4a3c38c807f6, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=27767633-1ab7-44d5-890c-4a3c38c807f6,segment=NetworkSegment(84e8dda5-3747-4e23-984b-1e3957701cfb),segment_id=84e8dda5-3747-4e23-984b-1e3957701cfb)] {{(pid=102326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:23:55.063713 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-710ba143-1baf-4239-be84-39d0f3afcc2b None None] Provisioning complete for port 27767633-1ab7-44d5-890c-4a3c38c807f6 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:55.064280 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-710ba143-1baf-4239-be84-39d0f3afcc2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:55.101910 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-710ba143-1baf-4239-be84-39d0f3afcc2b None None] Port 27767633-1ab7-44d5-890c-4a3c38c807f6 cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:23:55.107936 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:55.119152 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-78426082-de12-478e-9173-c8ef1598f7ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:55.120150 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78426082-de12-478e-9173-c8ef1598f7ee admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:55.120754 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-78426082-de12-478e-9173-c8ef1598f7ee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:55.173896 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Routers {'fbdb60a9-d48f-44d5-a652-95278f391d51'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:23:55.174706 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:23:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['fbdb60a9-d48f-44d5-a652-95278f391d51'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:55.184679 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78426082-de12-478e-9173-c8ef1598f7ee admin admin] Pushing event updated for resources: {'Network': ['ID=42706a37-4e5e-4c27-977c-73e50e8cd1d2,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:55.196164 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network 42706a37-4e5e-4c27-977c-73e50e8cd1d2 details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:23:55.215793 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d5e59ec-0e74-49ac-b458-0182ef35971f None None] Pushing event updated for resources: {'Port': ['ID=27767633-1ab7-44d5-890c-4a3c38c807f6,revision_number=4']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:55.229447 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-78426082-de12-478e-9173-c8ef1598f7ee admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.5964940 Nov 11 17:23:55.232222 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36842) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:55.237949 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-9c9a851c-b724-4ca7-8dcd-6f07879888ae admin admin] Request body: {'subnet': {'network_id': '42706a37-4e5e-4c27-977c-73e50e8cd1d2', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-639218667-subnet', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'ip_version': 4}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:23:55.330698 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b7c76773-c935-41c5-a622-009ca7261f40 req-dc000c14-e47e-4c7a-b474-a950e6d45051 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d756663-1f8a-4181-884f-ba0ae9a11772 HTTP/1.1" status: 200 len: 210 time: 0.0609961 Nov 11 17:23:55.364919 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] Set router fbdb60a9-d48f-44d5-a652-95278f391d51 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:23:55.422382 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-d2124f26-ca62-4a90-b0bd-bdee3559eadc None None] Provisioning complete for port 27767633-1ab7-44d5-890c-4a3c38c807f6 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:55.422713 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-d2124f26-ca62-4a90-b0bd-bdee3559eadc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:55.439582 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9c9a851c-b724-4ca7-8dcd-6f07879888ae admin admin] Made reservation on behalf of 8095b1a7a6bf4328a88245aa063676bf for: {'subnet': 1} {{(pid=102323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:23:55.443180 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9c9a851c-b724-4ca7-8dcd-6f07879888ae admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5388291'] for subnet, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:55.511635 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-d2124f26-ca62-4a90-b0bd-bdee3559eadc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:55.567179 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-d2124f26-ca62-4a90-b0bd-bdee3559eadc None None] For port 27767633-1ab7-44d5-890c-4a3c38c807f6, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=27767633-1ab7-44d5-890c-4a3c38c807f6,segment=NetworkSegment(84e8dda5-3747-4e23-984b-1e3957701cfb),segment_id=84e8dda5-3747-4e23-984b-1e3957701cfb)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:55.593137 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'name': 'tempest-TestShelveInstance-1336680617-router', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13'}], 'enable_snat': True}, 'gw_port_id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:47Z', 'updated_at': '2021-11-11T17:23:52Z', 'revision_number': 4, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'gw_port': {'id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:48:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:48Z', 'updated_at': '2021-11-11T17:23:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '27767633-1ab7-44d5-890c-4a3c38c807f6', 'name': '', 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'mac_address': 'fa:16:3e:6a:e7:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:51Z', 'updated_at': '2021-11-11T17:23:54Z', 'revision_number': 4, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'subnets': [{'id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:55.603780 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 312d3448-1034-4dc3-8ce7-a0402912f35d up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:23:55.627690 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-921e81e6-63d1-4f63-a385-405e68b968f0 None None] The sync data for ids ['fbdb60a9-d48f-44d5-a652-95278f391d51'] in dv-cinder-694140-2-iscsi is: [{'id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'name': 'tempest-TestShelveInstance-1336680617-router', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13'}], 'enable_snat': True}, 'gw_port_id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:47Z', 'updated_at': '2021-11-11T17:23:52Z', 'revision_number': 4, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'gw_port': {'id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:48:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:48Z', 'updated_at': '2021-11-11T17:23:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '27767633-1ab7-44d5-890c-4a3c38c807f6', 'name': '', 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'mac_address': 'fa:16:3e:6a:e7:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:51Z', 'updated_at': '2021-11-11T17:23:54Z', 'revision_number': 4, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'subnets': [{'id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:23:55.628362 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-d2124f26-ca62-4a90-b0bd-bdee3559eadc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:55.713985 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9c9a851c-b724-4ca7-8dcd-6f07879888ae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5720706', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5388333'] for subnet, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:55.730070 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2124f26-ca62-4a90-b0bd-bdee3559eadc None None] Pushing event updated for resources: {'Port': ['ID=27767633-1ab7-44d5-890c-4a3c38c807f6,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:55.734920 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 312d3448-1034-4dc3-8ce7-a0402912f35d triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:55.736546 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:55.777398 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c9a851c-b724-4ca7-8dcd-6f07879888ae admin admin] Pushing event updated for resources: {'Subnet': ['ID=62e9b4fb-76e3-4652-bdd9-ec31fd104157,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:55.801257 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f3508ea-1595-4a58-98cd-9c2669c48f9b req-702b51d0-94c8-4228-b735-7235a8f5d576 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:55.802845 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3f3508ea-1595-4a58-98cd-9c2669c48f9b req-702b51d0-94c8-4228-b735-7235a8f5d576 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 943 time: 0.0841315 Nov 11 17:23:55.811852 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c9a851c-b724-4ca7-8dcd-6f07879888ae admin admin] Checking segment: {'id': '110e841e-0526-4369-97dd-11f0bc420155', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': '42706a37-4e5e-4c27-977c-73e50e8cd1d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:23:55.812742 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c9a851c-b724-4ca7-8dcd-6f07879888ae admin admin] Network hostable DHCP agents. Network: 42706a37-4e5e-4c27-977c-73e50e8cd1d2, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102323) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:23:55.864026 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3f3508ea-1595-4a58-98cd-9c2669c48f9b req-ffd4e850-851c-4f1b-a1c5-942de4ad6962 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0534728 Nov 11 17:23:55.879354 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c9a851c-b724-4ca7-8dcd-6f07879888ae admin admin] Network 42706a37-4e5e-4c27-977c-73e50e8cd1d2 is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102323) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:23:55.953438 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-9c9a851c-b724-4ca7-8dcd-6f07879888ae admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, 42706a37-4e5e-4c27-977c-73e50e8cd1d2) {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:23:55.957537 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c9a851c-b724-4ca7-8dcd-6f07879888ae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:55.958673 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9c9a851c-b724-4ca7-8dcd-6f07879888ae admin admin] Publish callbacks [] for subnet, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:55.964828 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b3857d6-29f5-4746-a044-ba7f980b0828 None None] Network 42706a37-4e5e-4c27-977c-73e50e8cd1d2 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:23:56.048013 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-9c9a851c-b724-4ca7-8dcd-6f07879888ae admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.8139095 Nov 11 17:23:56.050297 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36846) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:56.054864 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-639218667-router', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:23:56.142404 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-424378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7339'] for router, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:56.143664 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-424390', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-397156', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7867629', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7328'] for router, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:56.207477 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:56.250844 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaac6311d-333a-5f5f-a33c-91960009c34a-42706a37-4e5e-4c27-977c-73e50e8cd1d2', 'network_id': '42706a37-4e5e-4c27-977c-73e50e8cd1d2', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'fixed_ips': [{'subnet_id': '62e9b4fb-76e3-4652-bdd9-ec31fd104157'}]}} from dv-cinder-694140-2-iscsi. {{(pid=102325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 17:23:56.251854 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:56.395433 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:56.415705 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.db_base_plugin_common [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Allocated IP 172.20.0.2 (42706a37-4e5e-4c27-977c-73e50e8cd1d2/62e9b4fb-76e3-4652-bdd9-ec31fd104157/c5dc949a-ac8b-4fe8-947c-4a1081166158) {{(pid=102325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:23:56.442499 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 6176c69f-e97f-44c0-93d8-bad69dcaac9c details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:23:56.482298 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 18cd1277-d6d0-48b5-bbbc-c0b112fe275f no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:23:56.516949 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: 18cd1277-d6d0-48b5-bbbc-c0b112fe275f {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:23:56.517405 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 18cd1277-d6d0-48b5-bbbc-c0b112fe275f not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:23:56.674807 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 6176c69f-e97f-44c0-93d8-bad69dcaac9c, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=6176c69f-e97f-44c0-93d8-bad69dcaac9c,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:56.684649 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Publish callbacks [] for port, precommit_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:56.687126 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:56.690290 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '6176c69f-e97f-44c0-93d8-bad69dcaac9c', 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c', 'port_id': '6176c69f-e97f-44c0-93d8-bad69dcaac9c', 'mac_address': 'fa:16:3e:fe:ac:11', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 515, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '92bc39c3-f62a-4a09-b809-9f253b9c7487', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:23:56.707467 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:56.734196 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:56.748904 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6176c69f-e97f-44c0-93d8-bad69dcaac9c {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:23:56.762338 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624'] for port, after_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:56.780052 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 6176c69f-e97f-44c0-93d8-bad69dcaac9c, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=6176c69f-e97f-44c0-93d8-bad69dcaac9c,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:56.808195 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Network 42706a37-4e5e-4c27-977c-73e50e8cd1d2 is already hosted by enough agents. {{(pid=102325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:23:56.811048 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.base_scheduler [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Resources bound (agent type, host, resource id): {{(pid=102325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:23:56.816792 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Received port after_create {{(pid=102325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:23:56.826144 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Allocated IP 172.27.1.37 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/3a14f879-20b5-41bd-b3be-a801454d0987) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:23:56.829795 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Pushing event updated for resources: {'Port': ['ID=c5dc949a-ac8b-4fe8-947c-4a1081166158,revision_number=1']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:56.873185 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:56.903138 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Attempting to bind port c5dc949a-ac8b-4fe8-947c-4a1081166158 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:23:56.904082 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Attempting to bind port c5dc949a-ac8b-4fe8-947c-4a1081166158 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '110e841e-0526-4369-97dd-11f0bc420155', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': '42706a37-4e5e-4c27-977c-73e50e8cd1d2'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:23:56.904082 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Attempting to bind port c5dc949a-ac8b-4fe8-947c-4a1081166158 on network 42706a37-4e5e-4c27-977c-73e50e8cd1d2 {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:23:56.917759 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 23, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:23:56.918136 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Checking segment: {'id': '110e841e-0526-4369-97dd-11f0bc420155', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': '42706a37-4e5e-4c27-977c-73e50e8cd1d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:23:56.919046 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:56.919046 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Bound using segment: {'id': '110e841e-0526-4369-97dd-11f0bc420155', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': '42706a37-4e5e-4c27-977c-73e50e8cd1d2'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:23:56.919406 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Bound port: c5dc949a-ac8b-4fe8-947c-4a1081166158, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '110e841e-0526-4369-97dd-11f0bc420155', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': '42706a37-4e5e-4c27-977c-73e50e8cd1d2'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:23:56.919792 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:56.936296 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:56.966825 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=6176c69f-e97f-44c0-93d8-bad69dcaac9c,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:56.993835 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-121165d9-0406-499c-8ffe-c7ed9365234b req-6d64250e-322f-4aad-9f8d-7ab169f15d65 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:56.995372 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-121165d9-0406-499c-8ffe-c7ed9365234b req-6d64250e-322f-4aad-9f8d-7ab169f15d65 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 944 time: 0.0573962 Nov 11 17:23:57.003280 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] For port c5dc949a-ac8b-4fe8-947c-4a1081166158, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:23:57.010135 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] For port c5dc949a-ac8b-4fe8-947c-4a1081166158, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=c5dc949a-ac8b-4fe8-947c-4a1081166158,segment=NetworkSegment(110e841e-0526-4369-97dd-11f0bc420155),segment_id=110e841e-0526-4369-97dd-11f0bc420155)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:23:57.043339 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-121165d9-0406-499c-8ffe-c7ed9365234b req-f0ba8c60-1944-49fa-9061-162d432b0218 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412276 Nov 11 17:23:57.051346 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:57.091811 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:23:57.096882 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:23:57.100711 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:23:57.113952 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:57.126700 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Pushing event updated for resources: {'Port': ['ID=3a14f879-20b5-41bd-b3be-a801454d0987,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:57.151664 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['6176c69f-e97f-44c0-93d8-bad69dcaac9c'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:23:57.212746 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e7e2b9a-17e3-43d0-9936-acbec42c6d8e None None] Pushing event updated for resources: {'Port': ['ID=c5dc949a-ac8b-4fe8-947c-4a1081166158,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:57.452179 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:57.654250 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 27767633-1ab7-44d5-890c-4a3c38c807f6 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:23:57.721839 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 27767633-1ab7-44d5-890c-4a3c38c807f6 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:57.722207 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:57.805251 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device c5dc949a-ac8b-4fe8-947c-4a1081166158 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:23:57.857917 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port c5dc949a-ac8b-4fe8-947c-4a1081166158 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:57.858288 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:57.942961 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-424501', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-397235'] for router, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:57.943882 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:57.978285 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] For port c5dc949a-ac8b-4fe8-947c-4a1081166158, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=c5dc949a-ac8b-4fe8-947c-4a1081166158,segment=NetworkSegment(110e841e-0526-4369-97dd-11f0bc420155),segment_id=110e841e-0526-4369-97dd-11f0bc420155)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:58.067937 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:58.119648 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9b8a4df0-bfa8-4d87-afce-3ad0add7ff8f None None] Network 42706a37-4e5e-4c27-977c-73e50e8cd1d2 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:23:58.143042 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Pushing event updated for resources: {'Port': ['ID=c5dc949a-ac8b-4fe8-947c-4a1081166158,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:58.182558 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Router 3a394120-b947-4f24-bed7-90459f716ef2 is scheduled to L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 with binding_index 1 {{(pid=102323) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 17:23:58.201276 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0c35f2-ff8d-43d4-88c7-fc24c90943cf req-271f97c5-2e4f-4fd1-bfbf-32f646e76efb tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:58.202715 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1e0c35f2-ff8d-43d4-88c7-fc24c90943cf req-271f97c5-2e4f-4fd1-bfbf-32f646e76efb tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 944 time: 0.0613348 Nov 11 17:23:58.206569 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-f9ddc990-a53d-4184-8889-96625a512add None None] Provisioning complete for port c5dc949a-ac8b-4fe8-947c-4a1081166158 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:58.206915 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-f9ddc990-a53d-4184-8889-96625a512add None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:58.326889 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1e0c35f2-ff8d-43d4-88c7-fc24c90943cf req-bad9bb6b-adcd-4ce6-81e5-91e6083965e9 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0904181 Nov 11 17:23:58.337118 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:23:58.349687 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Sync routers for ids ['3a394120-b947-4f24-bed7-90459f716ef2'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:23:58.367071 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Routers {'3a394120-b947-4f24-bed7-90459f716ef2'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:23:58.368058 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:23:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['3a394120-b947-4f24-bed7-90459f716ef2'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:58.424020 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] Publish callbacks [] for router, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:58.425304 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-9b3355b4-40d6-4fc3-b7b6-a77f59bdfb87 admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 2.3739655 Nov 11 17:23:58.428198 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36864) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:58.456833 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 6176c69f-e97f-44c0-93d8-bad69dcaac9c up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:23:58.515831 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Set router 3a394120-b947-4f24-bed7-90459f716ef2 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:23:58.696018 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port 6176c69f-e97f-44c0-93d8-bad69dcaac9c completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:23:58.704928 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 6176c69f-e97f-44c0-93d8-bad69dcaac9c triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:58.705295 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:58.714716 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4f8e2752-458a-43b4-a15f-cd421cc8360f None None] Provisioning complete for port c5dc949a-ac8b-4fe8-947c-4a1081166158 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:58.714716 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4f8e2752-458a-43b4-a15f-cd421cc8360f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:58.821062 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a394120-b947-4f24-bed7-90459f716ef2', 'name': 'tempest-TestShelveInstance-639218667-router', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.37'}], 'enable_snat': True}, 'gw_port_id': '3a14f879-20b5-41bd-b3be-a801454d0987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:56Z', 'updated_at': '2021-11-11T17:23:57Z', 'revision_number': 3, 'project_id': '8095b1a7a6bf4328a88245aa063676bf', 'gw_port': {'id': '3a14f879-20b5-41bd-b3be-a801454d0987', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:da:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a394120-b947-4f24-bed7-90459f716ef2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 621, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:56Z', 'updated_at': '2021-11-11T17:23:56Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:58.849306 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:58.871234 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 36868) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:23:59.007035 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Checking router: 3a394120-b947-4f24-bed7-90459f716ef2 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:23:59.007402 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Updating router 3a394120-b947-4f24-bed7-90459f716ef2 port 3a14f879-20b5-41bd-b3be-a801454d0987 binding host dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:23:59.024996 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Allocated IP 172.20.0.1 (42706a37-4e5e-4c27-977c-73e50e8cd1d2/62e9b4fb-76e3-4652-bdd9-ec31fd104157/c6384c39-1e15-446b-98aa-e19adbecc47a) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:23:59.040478 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-a578c351-9520-4d53-8866-39a9589385ff tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Deleting port c814254e-6f6c-47b3-88fe-96b8e83aeaac {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:23:59.040822 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a578c351-9520-4d53-8866-39a9589385ff tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.043011 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.056442 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.087187 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd4ee3379-5ccf-431e-8f53-6626b9a4b498', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6176c69f-e97f-44c0-93d8-bad69dcaac9c'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:23:59.089435 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-63fea4c5-e991-4a35-9392-73c64b8637a0" -d '{"events": [{"server_uuid": "d4ee3379-5ccf-431e-8f53-6626b9a4b498", "name": "network-vif-plugged", "status": "completed", "tag": "6176c69f-e97f-44c0-93d8-bad69dcaac9c"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:23:59.110424 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 6176c69f-e97f-44c0-93d8-bad69dcaac9c, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=6176c69f-e97f-44c0-93d8-bad69dcaac9c,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:23:59.142933 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a578c351-9520-4d53-8866-39a9589385ff tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.143256 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a578c351-9520-4d53-8866-39a9589385ff tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.160516 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-a578c351-9520-4d53-8866-39a9589385ff tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Calling delete_port for c814254e-6f6c-47b3-88fe-96b8e83aeaac owned by network:floatingip {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:23:59.165763 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:23:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7b8f163c-9ca7-4254-a593-c76ae65d4f71 x-openstack-request-id: req-7b8f163c-9ca7-4254-a593-c76ae65d4f71 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:23:59.166081 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d4ee3379-5ccf-431e-8f53-6626b9a4b498", "name": "network-vif-plugged", "status": "completed", "tag": "6176c69f-e97f-44c0-93d8-bad69dcaac9c", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:23:59.166298 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-7b8f163c-9ca7-4254-a593-c76ae65d4f71 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:23:59.166781 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd4ee3379-5ccf-431e-8f53-6626b9a4b498', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6176c69f-e97f-44c0-93d8-bad69dcaac9c', 'code': 200} Nov 11 17:23:59.180628 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.184145 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.288865 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=6176c69f-e97f-44c0-93d8-bad69dcaac9c,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:59.342168 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.385393 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Network 42706a37-4e5e-4c27-977c-73e50e8cd1d2 is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:23:59.394904 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:23:59.402432 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:23:59.410633 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a578c351-9520-4d53-8866-39a9589385ff tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.418239 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Publish callbacks [] for port, precommit_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.441033 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Pushing event updated for resources: {'Port': ['ID=c6384c39-1e15-446b-98aa-e19adbecc47a,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:59.442988 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a578c351-9520-4d53-8866-39a9589385ff tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event deleted for resources: {'Port': ['ID=c814254e-6f6c-47b3-88fe-96b8e83aeaac,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:59.484566 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-394084'] for router_interface, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.531857 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.542288 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a578c351-9520-4d53-8866-39a9589385ff tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for floatingip, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.542648 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.l3_db [None req-a578c351-9520-4d53-8866-39a9589385ff tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Floating IP 98da0cbf-ec1c-4c72-a17d-c2c96671021e disassociated (deleted). External IP: 172.27.1.133, port: 5d28ea1f-ba26-4f7e-93e2-89690070a29f. Nov 11 17:23:59.557760 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb6e25c3-9e13-46ea-907e-733e5a10856c req-9b24dc06-3157-455c-8a3a-a97a41bde445 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:59.560235 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-eb6e25c3-9e13-46ea-907e-733e5a10856c req-9b24dc06-3157-455c-8a3a-a97a41bde445 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 945 time: 0.1313477 Nov 11 17:23:59.651304 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56a2bc7b-22fc-4732-84c2-3388bbe00508 req-6701ce03-cfa3-4e5b-94f2-40a0a23f3c48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:23:59.652823 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-56a2bc7b-22fc-4732-84c2-3388bbe00508 req-6701ce03-cfa3-4e5b-94f2-40a0a23f3c48 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 1098 time: 0.1778905 Nov 11 17:23:59.654781 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d27b92cf-883f-4e83-b1bf-94d6efcb9f61 None None] Pushing event updated for resources: {'Port': ['ID=3a14f879-20b5-41bd-b3be-a801454d0987,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:59.658993 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-eb6e25c3-9e13-46ea-907e-733e5a10856c req-fbcfaf92-4d31-4608-a323-e6b631a253af tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0705683 Nov 11 17:23:59.669302 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device c5dc949a-ac8b-4fe8-947c-4a1081166158 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:23:59.704374 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Attempting to bind port 3a14f879-20b5-41bd-b3be-a801454d0987 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:23:59.705051 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Attempting to bind port 3a14f879-20b5-41bd-b3be-a801454d0987 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:23:59.705051 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Attempting to bind port 3a14f879-20b5-41bd-b3be-a801454d0987 on network 78b17769-6fae-453e-8ae3-4a72e72bccfc {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:23:59.717348 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 23, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:23:59.720785 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Checking segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:23:59.720785 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.720785 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Bound using segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:23:59.720785 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Bound port: 3a14f879-20b5-41bd-b3be-a801454d0987, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:23:59.720785 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.734036 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.773336 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-56a2bc7b-22fc-4732-84c2-3388bbe00508 req-399d662d-d0c2-4e9a-afcf-b82997076813 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1080902 Nov 11 17:23:59.796667 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port c5dc949a-ac8b-4fe8-947c-4a1081166158 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:59.796991 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.798522 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-d0d95dfb-4cbd-4cee-9e25-e9d739f80304 None None] Provisioning complete for port c6384c39-1e15-446b-98aa-e19adbecc47a triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:23:59.798900 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-d0d95dfb-4cbd-4cee-9e25-e9d739f80304 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.801538 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] For port 3a14f879-20b5-41bd-b3be-a801454d0987, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:23:59.804899 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] For port 3a14f879-20b5-41bd-b3be-a801454d0987, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=3a14f879-20b5-41bd-b3be-a801454d0987,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:23:59.832464 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a578c351-9520-4d53-8866-39a9589385ff tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Router 1267b92b-e259-4df2-9704-b862470a9e03 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:23:59.864014 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-d0d95dfb-4cbd-4cee-9e25-e9d739f80304 None None] Port c6384c39-1e15-446b-98aa-e19adbecc47a cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:23:59.910170 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.930144 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.953408 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a578c351-9520-4d53-8866-39a9589385ff tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:23:59.960549 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a578c351-9520-4d53-8866-39a9589385ff tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:23:59.968336 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24360835-172e-4330-8d1a-01f982ca1224 None None] Sync routers for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:23:59.980989 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24360835-172e-4330-8d1a-01f982ca1224 None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:23:59.981830 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-24360835-172e-4330-8d1a-01f982ca1224 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:23:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:59.983150 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d27b92cf-883f-4e83-b1bf-94d6efcb9f61 None None] Pushing event updated for resources: {'Port': ['ID=3a14f879-20b5-41bd-b3be-a801454d0987,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:23:59.989323 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Routers {'3a394120-b947-4f24-bed7-90459f716ef2'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:23:59.989952 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:23:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['3a394120-b947-4f24-bed7-90459f716ef2'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:23:59.994972 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-a578c351-9520-4d53-8866-39a9589385ff tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "DELETE /v2.0/floatingips/98da0cbf-ec1c-4c72-a17d-c2c96671021e HTTP/1.1" status: 204 len: 168 time: 1.1220167 Nov 11 17:23:59.996042 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'tag': '5d28ea1f-ba26-4f7e-93e2-89690070a29f'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:23:59.998716 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-59159d37-acee-4dc1-b129-7b12fb2ee5a7" -d '{"events": [{"name": "network-changed", "server_uuid": "08f1424d-ebf2-4f7e-aeb0-f24dcec12607", "tag": "5d28ea1f-ba26-4f7e-93e2-89690070a29f"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:24:00.010823 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:00.074119 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:24:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d2bbca25-35fb-46df-8579-0cf38ef8d1dc x-openstack-request-id: req-d2bbca25-35fb-46df-8579-0cf38ef8d1dc {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:24:00.074119 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "08f1424d-ebf2-4f7e-aeb0-f24dcec12607", "tag": "5d28ea1f-ba26-4f7e-93e2-89690070a29f", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:24:00.074363 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-d2bbca25-35fb-46df-8579-0cf38ef8d1dc {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:24:00.074784 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'tag': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'status': 'completed', 'code': 200} Nov 11 17:24:00.140638 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-24360835-172e-4330-8d1a-01f982ca1224 None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:24:00.145876 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8103788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-394224'] for router_interface, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:00.146100 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] Set router 3a394120-b947-4f24-bed7-90459f716ef2 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:24:00.148965 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Pushing event updated for resources: {'Port': ['ID=c6384c39-1e15-446b-98aa-e19adbecc47a,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:00.154796 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59159d37-acee-4dc1-b129-7b12fb2ee5a7 req-9e5bc5a6-95ed-49eb-9f6b-c89a06e9dcd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:00.156405 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-59159d37-acee-4dc1-b129-7b12fb2ee5a7 req-9e5bc5a6-95ed-49eb-9f6b-c89a06e9dcd6 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=10bedfb35d1e481aa78e025489c1be2d&device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 1098 time: 0.0560493 Nov 11 17:24:00.273630 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59159d37-acee-4dc1-b129-7b12fb2ee5a7 req-9dc0234a-df14-4af2-b21b-9f216b6e1af9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:00.276285 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-59159d37-acee-4dc1-b129-7b12fb2ee5a7 req-9dc0234a-df14-4af2-b21b-9f216b6e1af9 service neutron] 10.222.0.10 "GET /v2.0/networks?id=45e6626a-2007-490b-a445-d7c3baea689e HTTP/1.1" status: 200 len: 912 time: 0.1096601 Nov 11 17:24:00.283201 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Network 42706a37-4e5e-4c27-977c-73e50e8cd1d2 is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:24:00.284952 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:24:00.352951 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-59159d37-acee-4dc1-b129-7b12fb2ee5a7 req-b942bf6b-a813-47fa-8069-58b8c3e84dee service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5d28ea1f-ba26-4f7e-93e2-89690070a29f HTTP/1.1" status: 200 len: 217 time: 0.0684121 Nov 11 17:24:00.425627 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-24360835-172e-4330-8d1a-01f982ca1224 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:00.426838 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a394120-b947-4f24-bed7-90459f716ef2', 'name': 'tempest-TestShelveInstance-639218667-router', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.37'}], 'enable_snat': True}, 'gw_port_id': '3a14f879-20b5-41bd-b3be-a801454d0987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:56Z', 'updated_at': '2021-11-11T17:23:59Z', 'revision_number': 4, 'project_id': '8095b1a7a6bf4328a88245aa063676bf', 'gw_port': {'id': '3a14f879-20b5-41bd-b3be-a801454d0987', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:da:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a394120-b947-4f24-bed7-90459f716ef2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 621, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:56Z', 'updated_at': '2021-11-11T17:23:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'c6384c39-1e15-446b-98aa-e19adbecc47a', 'name': '', 'network_id': '42706a37-4e5e-4c27-977c-73e50e8cd1d2', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'mac_address': 'fa:16:3e:f4:71:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a394120-b947-4f24-bed7-90459f716ef2', 'device_owner': 'network:router_interface', 'standard_attr_id': 622, 'fixed_ips': [{'subnet_id': '62e9b4fb-76e3-4652-bdd9-ec31fd104157', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:58Z', 'updated_at': '2021-11-11T17:23:59Z', 'revision_number': 1, 'project_id': '8095b1a7a6bf4328a88245aa063676bf', 'subnets': [{'id': '62e9b4fb-76e3-4652-bdd9-ec31fd104157', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:00.445961 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59159d37-acee-4dc1-b129-7b12fb2ee5a7 req-a07746a7-2fb4-4ce7-9589-b5907e337af3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:00.449346 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-59159d37-acee-4dc1-b129-7b12fb2ee5a7 req-a07746a7-2fb4-4ce7-9589-b5907e337af3 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=bf78c82f-f2f3-4ef7-8052-be816dbd2df8 HTTP/1.1" status: 200 len: 850 time: 0.0876784 Nov 11 17:24:00.454965 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24360835-172e-4330-8d1a-01f982ca1224 None None] Checking router: 1267b92b-e259-4df2-9704-b862470a9e03 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:24:00.460753 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Router 3a394120-b947-4f24-bed7-90459f716ef2 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:24:00.468623 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24360835-172e-4330-8d1a-01f982ca1224 None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:24:00.469231 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-24360835-172e-4330-8d1a-01f982ca1224 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:23:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:00.496353 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81a50ec3-eaee-4fb2-a4b2-eedc32238d9d None None] The sync data for ids ['3a394120-b947-4f24-bed7-90459f716ef2'] in dv-cinder-694140-2-iscsi is: [{'id': '3a394120-b947-4f24-bed7-90459f716ef2', 'name': 'tempest-TestShelveInstance-639218667-router', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.37'}], 'enable_snat': True}, 'gw_port_id': '3a14f879-20b5-41bd-b3be-a801454d0987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:56Z', 'updated_at': '2021-11-11T17:23:59Z', 'revision_number': 4, 'project_id': '8095b1a7a6bf4328a88245aa063676bf', 'gw_port': {'id': '3a14f879-20b5-41bd-b3be-a801454d0987', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:da:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a394120-b947-4f24-bed7-90459f716ef2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 621, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:56Z', 'updated_at': '2021-11-11T17:23:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'c6384c39-1e15-446b-98aa-e19adbecc47a', 'name': '', 'network_id': '42706a37-4e5e-4c27-977c-73e50e8cd1d2', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'mac_address': 'fa:16:3e:f4:71:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a394120-b947-4f24-bed7-90459f716ef2', 'device_owner': 'network:router_interface', 'standard_attr_id': 622, 'fixed_ips': [{'subnet_id': '62e9b4fb-76e3-4652-bdd9-ec31fd104157', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:58Z', 'updated_at': '2021-11-11T17:23:59Z', 'revision_number': 1, 'project_id': '8095b1a7a6bf4328a88245aa063676bf', 'subnets': [{'id': '62e9b4fb-76e3-4652-bdd9-ec31fd104157', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:24:00.537864 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59159d37-acee-4dc1-b129-7b12fb2ee5a7 req-83e67269-cde7-45d3-8757-6bd504711f93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:00.541947 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-59159d37-acee-4dc1-b129-7b12fb2ee5a7 req-83e67269-cde7-45d3-8757-6bd504711f93 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=45e6626a-2007-490b-a445-d7c3baea689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0797315 Nov 11 17:24:00.645115 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-24360835-172e-4330-8d1a-01f982ca1224 None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:24:00.657611 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:24:00.669919 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-5fcd6ec9-111e-4fe9-90a1-03af416882cb admin admin] 10.222.0.16 "PUT /v2.0/routers/3a394120-b947-4f24-bed7-90459f716ef2/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2335820 Nov 11 17:24:00.670108 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-59159d37-acee-4dc1-b129-7b12fb2ee5a7 req-9482f385-e8b8-40df-ba91-f2c34120cd37 service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1186416 Nov 11 17:24:00.695527 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09befa2c-fe58-450c-b0a4-86d23706b180 req-64685682-5fb4-4045-adb7-72ce76dd6305 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:00.697043 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-09befa2c-fe58-450c-b0a4-86d23706b180 req-64685682-5fb4-4045-adb7-72ce76dd6305 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 945 time: 0.1504526 Nov 11 17:24:00.703597 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-c1421699-46d3-4146-80e1-08a7e7d9b5af None None] Provisioning complete for port c6384c39-1e15-446b-98aa-e19adbecc47a triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:24:00.703981 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c1421699-46d3-4146-80e1-08a7e7d9b5af None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:00.790601 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-09befa2c-fe58-450c-b0a4-86d23706b180 req-eea88382-ddeb-4ebc-9ad0-7e51a158f289 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0842576 Nov 11 17:24:00.805974 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-c1421699-46d3-4146-80e1-08a7e7d9b5af None None] Port c6384c39-1e15-446b-98aa-e19adbecc47a cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:24:00.892449 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-59159d37-acee-4dc1-b129-7b12fb2ee5a7 req-ee98bcd9-70bd-4617-b772-2ee336d58bd7 service neutron] 10.222.0.10 "GET /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2124207 Nov 11 17:24:00.938683 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4874ceb1-a4ce-4dd5-ba48-b064135faacb req-69eb973c-0196-4528-bb26-d8bfce0c96fc tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:00.941300 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4874ceb1-a4ce-4dd5-ba48-b064135faacb req-69eb973c-0196-4528-bb26-d8bfce0c96fc tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 945 time: 0.1213903 Nov 11 17:24:00.988300 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-24360835-172e-4330-8d1a-01f982ca1224 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:01.013546 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4874ceb1-a4ce-4dd5-ba48-b064135faacb req-41c8d848-9add-4f4c-8cdd-00eed3b71e14 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0640025 Nov 11 17:24:01.050104 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-52dfc2f4-46cf-47e9-83b8-8aa47bd87693 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:01.129861 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24360835-172e-4330-8d1a-01f982ca1224 None None] The sync data for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi is: [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:16:11Z', 'revision_number': 4, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '170b88c1-ded4-4c5e-a307-63d78d797a5c', 'name': '', 'network_id': '45e6626a-2007-490b-a445-d7c3baea689e', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'mac_address': 'fa:16:3e:8c:e5:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:10Z', 'updated_at': '2021-11-11T17:16:17Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'subnets': [{'id': 'bf78c82f-f2f3-4ef7-8052-be816dbd2df8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:24:01.530210 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36888) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:01.534970 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-40720b9d-f327-468c-a2eb-2d65017c4659 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-267284263', 'description': 'tempest-secgroup-smoke-267284263 description', 'project_id': '53c4ca7574da4b2a868a39a52a98e620'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:24:01.633154 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-40720b9d-f327-468c-a2eb-2d65017c4659 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:01.700531 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-40720b9d-f327-468c-a2eb-2d65017c4659 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:01.775755 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-40720b9d-f327-468c-a2eb-2d65017c4659 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:01.805737 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40720b9d-f327-468c-a2eb-2d65017c4659 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b9ce3bfe-8c24-4f72-add6-2af585f671b3,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:01.846336 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-40720b9d-f327-468c-a2eb-2d65017c4659 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:01.847686 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-40720b9d-f327-468c-a2eb-2d65017c4659 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.3162539 Nov 11 17:24:01.851461 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 36892) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:01.855954 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-bf24b392-cf0b-46ce-9b22-b161ca594b2d tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Request body: {'security_group_rule': {'security_group_id': 'b9ce3bfe-8c24-4f72-add6-2af585f671b3', 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:24:01.918221 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ca2f9b9-f7b2-42a6-90fe-66fcc9f2be90 req-5ffbee48-af2c-4168-a0f5-d2f352565957 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:01.919630 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2ca2f9b9-f7b2-42a6-90fe-66fcc9f2be90 req-5ffbee48-af2c-4168-a0f5-d2f352565957 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 945 time: 0.0504537 Nov 11 17:24:01.967468 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bf24b392-cf0b-46ce-9b22-b161ca594b2d tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:01.983301 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2ca2f9b9-f7b2-42a6-90fe-66fcc9f2be90 req-f0164dd7-9d4e-49a9-a384-e2c0fcf97972 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/security-groups?id=a3fcdc84-afa7-461b-8091-b146ab222f62&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0576601 Nov 11 17:24:02.029598 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bf24b392-cf0b-46ce-9b22-b161ca594b2d tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:02.101384 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bf24b392-cf0b-46ce-9b22-b161ca594b2d tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:02.120303 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf24b392-cf0b-46ce-9b22-b161ca594b2d tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8f06a5d5-f0fd-402a-8368-1ff7a29702c1,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:02.143551 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dec0d3e-d2f8-4aaf-9048-404045d2d112 req-be2dc0a9-c7d4-4d3d-8dab-4774500b05c6 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:02.145000 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0dec0d3e-d2f8-4aaf-9048-404045d2d112 req-be2dc0a9-c7d4-4d3d-8dab-4774500b05c6 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 945 time: 0.0509002 Nov 11 17:24:02.192877 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1901d012-bb13-4bcd-8e74-a8ba763ac43d req-c24d76fc-5b9e-4d7a-8303-c9ffa12665f5 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:02.195029 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1901d012-bb13-4bcd-8e74-a8ba763ac43d req-c24d76fc-5b9e-4d7a-8303-c9ffa12665f5 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.10 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 945 time: 0.0530620 Nov 11 17:24:02.195337 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0dec0d3e-d2f8-4aaf-9048-404045d2d112 req-259850c0-abac-4dbe-851f-17a5f63c382e tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433588 Nov 11 17:24:02.198474 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bf24b392-cf0b-46ce-9b22-b161ca594b2d tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:02.199438 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-bf24b392-cf0b-46ce-9b22-b161ca594b2d tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3470027 Nov 11 17:24:02.202446 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36896) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:02.207116 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-f8cc7599-d194-4f26-9588-03b4d8221fd2 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Request body: {'security_group_rule': {'security_group_id': 'b9ce3bfe-8c24-4f72-add6-2af585f671b3', 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:24:02.329626 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f8cc7599-d194-4f26-9588-03b4d8221fd2 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:02.337546 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-1901d012-bb13-4bcd-8e74-a8ba763ac43d req-6a7f19cf-c435-4a67-9214-0a712cc2aad5 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Deleting port 5d28ea1f-ba26-4f7e-93e2-89690070a29f {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:24:02.337892 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-1901d012-bb13-4bcd-8e74-a8ba763ac43d req-6a7f19cf-c435-4a67-9214-0a712cc2aad5 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:02.380318 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33ce70c2-8b8d-4921-b7e4-a0261cecbfb8 None None] New status for floating IP 98da0cbf-ec1c-4c72-a17d-c2c96671021e: DOWN {{(pid=102325) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:24:02.449773 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f8cc7599-d194-4f26-9588-03b4d8221fd2 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:02.482096 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-1901d012-bb13-4bcd-8e74-a8ba763ac43d req-6a7f19cf-c435-4a67-9214-0a712cc2aad5 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] For port 5d28ea1f-ba26-4f7e-93e2-89690070a29f, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=5d28ea1f-ba26-4f7e-93e2-89690070a29f,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:02.482621 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-1901d012-bb13-4bcd-8e74-a8ba763ac43d req-6a7f19cf-c435-4a67-9214-0a712cc2aad5 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:02.497823 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-1901d012-bb13-4bcd-8e74-a8ba763ac43d req-6a7f19cf-c435-4a67-9214-0a712cc2aad5 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Calling delete_port for 5d28ea1f-ba26-4f7e-93e2-89690070a29f owned by compute:nova {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:24:02.518586 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f8cc7599-d194-4f26-9588-03b4d8221fd2 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:02.540154 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8cc7599-d194-4f26-9588-03b4d8221fd2 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=840c7d41-3c09-4071-a88b-ae3541eac6da,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:02.715493 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f8cc7599-d194-4f26-9588-03b4d8221fd2 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:02.716729 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-f8cc7599-d194-4f26-9588-03b4d8221fd2 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5132606 Nov 11 17:24:02.719517 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36910) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:02.725028 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-ba182436-4fad-47e9-984d-6a187aa2698f tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Request body: {'security_group_rule': {'security_group_id': 'b9ce3bfe-8c24-4f72-add6-2af585f671b3', 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:24:02.783535 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-1901d012-bb13-4bcd-8e74-a8ba763ac43d req-6a7f19cf-c435-4a67-9214-0a712cc2aad5 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:02.812100 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a7f19cf-c435-4a67-9214-0a712cc2aad5 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event deleted for resources: {'Port': ['ID=5d28ea1f-ba26-4f7e-93e2-89690070a29f,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:02.850584 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ba182436-4fad-47e9-984d-6a187aa2698f tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:02.860012 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-1901d012-bb13-4bcd-8e74-a8ba763ac43d req-6a7f19cf-c435-4a67-9214-0a712cc2aad5 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] No DVR routers for this DVR port 5d28ea1f-ba26-4f7e-93e2-89690070a29f on host hv-cinder-69414 {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:24:02.862750 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-1901d012-bb13-4bcd-8e74-a8ba763ac43d req-6a7f19cf-c435-4a67-9214-0a712cc2aad5 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:02.866282 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1901d012-bb13-4bcd-8e74-a8ba763ac43d req-6a7f19cf-c435-4a67-9214-0a712cc2aad5 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.10 "DELETE /v2.0/ports/5d28ea1f-ba26-4f7e-93e2-89690070a29f HTTP/1.1" status: 204 len: 173 time: 0.6651075 Nov 11 17:24:02.866779 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'name': 'network-vif-deleted', 'tag': '5d28ea1f-ba26-4f7e-93e2-89690070a29f'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:24:02.869127 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7c9ebceb-8925-4281-b6cd-753632c2e38f" -d '{"events": [{"server_uuid": "08f1424d-ebf2-4f7e-aeb0-f24dcec12607", "name": "network-vif-deleted", "tag": "5d28ea1f-ba26-4f7e-93e2-89690070a29f"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:24:02.914274 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:24:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-98d88ca4-20fb-40a5-a69c-ffa7454a582f x-openstack-request-id: req-98d88ca4-20fb-40a5-a69c-ffa7454a582f {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:24:02.914581 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "08f1424d-ebf2-4f7e-aeb0-f24dcec12607", "name": "network-vif-deleted", "tag": "5d28ea1f-ba26-4f7e-93e2-89690070a29f", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:24:02.914836 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-98d88ca4-20fb-40a5-a69c-ffa7454a582f {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:24:02.915236 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '08f1424d-ebf2-4f7e-aeb0-f24dcec12607', 'name': 'network-vif-deleted', 'tag': '5d28ea1f-ba26-4f7e-93e2-89690070a29f', 'status': 'completed', 'code': 200} Nov 11 17:24:02.937489 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ba182436-4fad-47e9-984d-6a187aa2698f tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:03.039159 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ba182436-4fad-47e9-984d-6a187aa2698f tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:03.070243 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba182436-4fad-47e9-984d-6a187aa2698f tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ca8b8402-f9c6-407a-865a-b78402816320,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:03.092733 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-26756c01-fb73-44b6-9518-7b4fe4052ea9 req-f5d851c6-6c68-4c34-bf3f-3efb7fb88647 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 210 time: 0.0331473 Nov 11 17:24:03.137006 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ba182436-4fad-47e9-984d-6a187aa2698f tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:03.138253 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-ba182436-4fad-47e9-984d-6a187aa2698f tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4176776 Nov 11 17:24:03.140972 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36918) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:03.145251 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-7ca4cc21-69b5-44fc-9fb7-5359a82d3d79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Request body: {'security_group_rule': {'security_group_id': 'b9ce3bfe-8c24-4f72-add6-2af585f671b3', 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:24:03.283796 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7ca4cc21-69b5-44fc-9fb7-5359a82d3d79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:03.341356 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7ca4cc21-69b5-44fc-9fb7-5359a82d3d79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:03.404188 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7ca4cc21-69b5-44fc-9fb7-5359a82d3d79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:03.424789 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ca4cc21-69b5-44fc-9fb7-5359a82d3d79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=035c7299-97bf-4b7b-8acc-a2a972edc255,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:03.518775 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4105dea1-e4e8-44e2-aa19-049aaa4f40ee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:03.521972 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7ca4cc21-69b5-44fc-9fb7-5359a82d3d79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:03.523424 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-7ca4cc21-69b5-44fc-9fb7-5359a82d3d79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3812327 Nov 11 17:24:03.530006 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36920) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:03.530386 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-07a7a8b7-1dc3-4a20-8e39-ceb1874602cf tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Request body: {'security_group_rule': {'security_group_id': 'b9ce3bfe-8c24-4f72-add6-2af585f671b3', 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:24:03.630412 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 3a14f879-20b5-41bd-b3be-a801454d0987 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:24:03.661300 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.securitygroups_db [None req-07a7a8b7-1dc3-4a20-8e39-ceb1874602cf tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Project 53c4ca7574da4b2a868a39a52a98e620 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 17:24:03.666951 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-07a7a8b7-1dc3-4a20-8e39-ceb1874602cf tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:03.677977 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 3a14f879-20b5-41bd-b3be-a801454d0987 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:24:03.678608 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:03.734068 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-07a7a8b7-1dc3-4a20-8e39-ceb1874602cf tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:03.759955 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:03.770271 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Sync routers for ids ['3a394120-b947-4f24-bed7-90459f716ef2'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:24:03.780773 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] For port 3a14f879-20b5-41bd-b3be-a801454d0987, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=3a14f879-20b5-41bd-b3be-a801454d0987,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:03.784788 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Routers {'3a394120-b947-4f24-bed7-90459f716ef2'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:24:03.784788 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:24:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['3a394120-b947-4f24-bed7-90459f716ef2'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:03.804403 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-07a7a8b7-1dc3-4a20-8e39-ceb1874602cf tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:03.820770 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07a7a8b7-1dc3-4a20-8e39-ceb1874602cf tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b55f51b4-3110-4995-b8e4-68772b173d51,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:03.890191 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Set router 3a394120-b947-4f24-bed7-90459f716ef2 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:24:03.890438 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:03.922073 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-07a7a8b7-1dc3-4a20-8e39-ceb1874602cf tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:03.923873 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-07a7a8b7-1dc3-4a20-8e39-ceb1874602cf tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3968930 Nov 11 17:24:03.926294 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36922) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:03.932817 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-27084fe5-c178-49ab-8498-863c4a7ff61a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Request body: {'security_group_rule': {'security_group_id': 'b9ce3bfe-8c24-4f72-add6-2af585f671b3', 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:24:03.956201 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Pushing event updated for resources: {'Port': ['ID=3a14f879-20b5-41bd-b3be-a801454d0987,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:04.033715 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.securitygroups_db [None req-27084fe5-c178-49ab-8498-863c4a7ff61a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Project 53c4ca7574da4b2a868a39a52a98e620 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 17:24:04.043674 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-27084fe5-c178-49ab-8498-863c4a7ff61a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:04.115804 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-27084fe5-c178-49ab-8498-863c4a7ff61a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:04.119939 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a394120-b947-4f24-bed7-90459f716ef2', 'name': 'tempest-TestShelveInstance-639218667-router', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.37'}], 'enable_snat': True}, 'gw_port_id': '3a14f879-20b5-41bd-b3be-a801454d0987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:56Z', 'updated_at': '2021-11-11T17:23:59Z', 'revision_number': 4, 'project_id': '8095b1a7a6bf4328a88245aa063676bf', 'gw_port': {'id': '3a14f879-20b5-41bd-b3be-a801454d0987', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:da:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a394120-b947-4f24-bed7-90459f716ef2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 621, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:56Z', 'updated_at': '2021-11-11T17:23:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'c6384c39-1e15-446b-98aa-e19adbecc47a', 'name': '', 'network_id': '42706a37-4e5e-4c27-977c-73e50e8cd1d2', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'mac_address': 'fa:16:3e:f4:71:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a394120-b947-4f24-bed7-90459f716ef2', 'device_owner': 'network:router_interface', 'standard_attr_id': 622, 'fixed_ips': [{'subnet_id': '62e9b4fb-76e3-4652-bdd9-ec31fd104157', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:58Z', 'updated_at': '2021-11-11T17:23:59Z', 'revision_number': 2, 'project_id': '8095b1a7a6bf4328a88245aa063676bf', 'subnets': [{'id': '62e9b4fb-76e3-4652-bdd9-ec31fd104157', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:04.149954 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Checking router: 3a394120-b947-4f24-bed7-90459f716ef2 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:24:04.150413 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Updating router 3a394120-b947-4f24-bed7-90459f716ef2 port c6384c39-1e15-446b-98aa-e19adbecc47a binding host dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:24:04.184862 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:04.192519 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-27084fe5-c178-49ab-8498-863c4a7ff61a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:04.218251 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27084fe5-c178-49ab-8498-863c4a7ff61a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5181d854-577d-4132-a9e0-574a0a04adc5,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:04.232668 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-58853a5c-f0f2-42ab-9724-4f8739263611 req-d6034b1e-b28f-4854-b07d-251edf792890 tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "GET /v2.0/ports?device_id=08f1424d-ebf2-4f7e-aeb0-f24dcec12607 HTTP/1.1" status: 200 len: 210 time: 0.0300829 Nov 11 17:24:04.336543 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-27084fe5-c178-49ab-8498-863c4a7ff61a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:04.337812 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-27084fe5-c178-49ab-8498-863c4a7ff61a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4104145 Nov 11 17:24:04.388832 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-175aa137-9427-4c18-853d-8e48622e08cb tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:04.399731 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-175aa137-9427-4c18-853d-8e48622e08cb tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/networks?id=0d49ad27-76fe-421c-86d6-138a53bc5d1c HTTP/1.1" status: 200 len: 815 time: 0.1196280 Nov 11 17:24:04.413761 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-19042a72-3bc6-4110-a470-ddceeba8a87c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/quotas/c02f323bd05c4d6bbbadfb2cf91bd62d HTTP/1.1" status: 200 len: 375 time: 0.0109563 Nov 11 17:24:04.479811 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 5d28ea1f-ba26-4f7e-93e2-89690070a29f no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:24:04.480223 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-f594f38b-6784-416c-8d95-b2be6883dc24 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=c02f323bd05c4d6bbbadfb2cf91bd62d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0568647 Nov 11 17:24:04.507435 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Publish callbacks [] for port, precommit_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:04.508062 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: 5d28ea1f-ba26-4f7e-93e2-89690070a29f {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:24:04.508685 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 5d28ea1f-ba26-4f7e-93e2-89690070a29f not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:24:04.586122 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-0f95a9a2-8383-4a0f-b280-05978619c3f4 service neutron] 10.222.0.16 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0990188 Nov 11 17:24:04.621712 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:04.651189 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:04.683843 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-064511ef-83cd-439a-8d01-3f53f1e64e41 service neutron] 10.222.0.16 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0915701 Nov 11 17:24:04.695134 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01c01ed5-958c-44d2-8f99-4298656a4dc9 None None] Pushing event updated for resources: {'Port': ['ID=c6384c39-1e15-446b-98aa-e19adbecc47a,revision_number=3']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:04.727109 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Attempting to bind port c6384c39-1e15-446b-98aa-e19adbecc47a on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:24:04.727470 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Attempting to bind port c6384c39-1e15-446b-98aa-e19adbecc47a by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '110e841e-0526-4369-97dd-11f0bc420155', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': '42706a37-4e5e-4c27-977c-73e50e8cd1d2'}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:24:04.728034 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Attempting to bind port c6384c39-1e15-446b-98aa-e19adbecc47a on network 42706a37-4e5e-4c27-977c-73e50e8cd1d2 {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:24:04.733714 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 23, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:24:04.734080 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Checking segment: {'id': '110e841e-0526-4369-97dd-11f0bc420155', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': '42706a37-4e5e-4c27-977c-73e50e8cd1d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:24:04.734697 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:04.735257 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Bound using segment: {'id': '110e841e-0526-4369-97dd-11f0bc420155', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': '42706a37-4e5e-4c27-977c-73e50e8cd1d2'} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:24:04.735729 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Bound port: c6384c39-1e15-446b-98aa-e19adbecc47a, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '110e841e-0526-4369-97dd-11f0bc420155', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': '42706a37-4e5e-4c27-977c-73e50e8cd1d2'}}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:24:04.736122 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:04.806837 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] For port c6384c39-1e15-446b-98aa-e19adbecc47a, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:24:04.810298 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] For port c6384c39-1e15-446b-98aa-e19adbecc47a, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=c6384c39-1e15-446b-98aa-e19adbecc47a,segment=NetworkSegment(110e841e-0526-4369-97dd-11f0bc420155),segment_id=110e841e-0526-4369-97dd-11f0bc420155)] {{(pid=102326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:24:04.879723 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:04.931565 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-48a7044f-33d0-4ac7-ae3c-d4a5064102c2 req-687d09e2-a3bc-4b3b-99e6-280387a1c7a2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 210 time: 0.0309072 Nov 11 17:24:04.951668 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Routers {'3a394120-b947-4f24-bed7-90459f716ef2'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:24:04.952295 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:24:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['3a394120-b947-4f24-bed7-90459f716ef2'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:04.968255 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-f7b9b1ea-d59e-4152-9f71-6e02ca5247ff None None] Provisioning complete for port c6384c39-1e15-446b-98aa-e19adbecc47a triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:24:04.968635 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-f7b9b1ea-d59e-4152-9f71-6e02ca5247ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:04.997977 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01c01ed5-958c-44d2-8f99-4298656a4dc9 None None] Pushing event updated for resources: {'Port': ['ID=c6384c39-1e15-446b-98aa-e19adbecc47a,revision_number=4']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:05.090877 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] Set router 3a394120-b947-4f24-bed7-90459f716ef2 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:24:05.099608 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-f7b9b1ea-d59e-4152-9f71-6e02ca5247ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:05.147075 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-f7b9b1ea-d59e-4152-9f71-6e02ca5247ff None None] For port c6384c39-1e15-446b-98aa-e19adbecc47a, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=c6384c39-1e15-446b-98aa-e19adbecc47a,segment=NetworkSegment(110e841e-0526-4369-97dd-11f0bc420155),segment_id=110e841e-0526-4369-97dd-11f0bc420155)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:05.232616 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-f7b9b1ea-d59e-4152-9f71-6e02ca5247ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:05.289811 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 36990) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:05.296713 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7b9b1ea-d59e-4152-9f71-6e02ca5247ff None None] Pushing event updated for resources: {'Port': ['ID=c6384c39-1e15-446b-98aa-e19adbecc47a,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:05.333909 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a394120-b947-4f24-bed7-90459f716ef2', 'name': 'tempest-TestShelveInstance-639218667-router', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.37'}], 'enable_snat': True}, 'gw_port_id': '3a14f879-20b5-41bd-b3be-a801454d0987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:56Z', 'updated_at': '2021-11-11T17:23:59Z', 'revision_number': 4, 'project_id': '8095b1a7a6bf4328a88245aa063676bf', 'gw_port': {'id': '3a14f879-20b5-41bd-b3be-a801454d0987', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:da:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a394120-b947-4f24-bed7-90459f716ef2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 621, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:56Z', 'updated_at': '2021-11-11T17:24:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'c6384c39-1e15-446b-98aa-e19adbecc47a', 'name': '', 'network_id': '42706a37-4e5e-4c27-977c-73e50e8cd1d2', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'mac_address': 'fa:16:3e:f4:71:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a394120-b947-4f24-bed7-90459f716ef2', 'device_owner': 'network:router_interface', 'standard_attr_id': 622, 'fixed_ips': [{'subnet_id': '62e9b4fb-76e3-4652-bdd9-ec31fd104157', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:58Z', 'updated_at': '2021-11-11T17:24:04Z', 'revision_number': 4, 'project_id': '8095b1a7a6bf4328a88245aa063676bf', 'subnets': [{'id': '62e9b4fb-76e3-4652-bdd9-ec31fd104157', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:05.357263 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-daffa3f1-0d9f-4529-9f08-73586ef3308a None None] Provisioning complete for port c6384c39-1e15-446b-98aa-e19adbecc47a triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:24:05.357871 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-daffa3f1-0d9f-4529-9f08-73586ef3308a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:05.376168 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8dbf09a-b013-4ccd-bd91-d4ea96693bfc None None] The sync data for ids ['3a394120-b947-4f24-bed7-90459f716ef2'] in dv-cinder-694140-2-iscsi is: [{'id': '3a394120-b947-4f24-bed7-90459f716ef2', 'name': 'tempest-TestShelveInstance-639218667-router', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.37'}], 'enable_snat': True}, 'gw_port_id': '3a14f879-20b5-41bd-b3be-a801454d0987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:56Z', 'updated_at': '2021-11-11T17:23:59Z', 'revision_number': 4, 'project_id': '8095b1a7a6bf4328a88245aa063676bf', 'gw_port': {'id': '3a14f879-20b5-41bd-b3be-a801454d0987', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:da:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a394120-b947-4f24-bed7-90459f716ef2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 621, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:56Z', 'updated_at': '2021-11-11T17:24:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'c6384c39-1e15-446b-98aa-e19adbecc47a', 'name': '', 'network_id': '42706a37-4e5e-4c27-977c-73e50e8cd1d2', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'mac_address': 'fa:16:3e:f4:71:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a394120-b947-4f24-bed7-90459f716ef2', 'device_owner': 'network:router_interface', 'standard_attr_id': 622, 'fixed_ips': [{'subnet_id': '62e9b4fb-76e3-4652-bdd9-ec31fd104157', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:58Z', 'updated_at': '2021-11-11T17:24:04Z', 'revision_number': 4, 'project_id': '8095b1a7a6bf4328a88245aa063676bf', 'subnets': [{'id': '62e9b4fb-76e3-4652-bdd9-ec31fd104157', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:24:05.503757 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-04e8c5ed-a8b8-4fd9-a902-14af9c68087b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Deleting port 802e1a48-f360-4544-b1c7-4ffe24ce9585 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:24:05.504255 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-04e8c5ed-a8b8-4fd9-a902-14af9c68087b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:05.606762 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-04e8c5ed-a8b8-4fd9-a902-14af9c68087b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:05.607226 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-04e8c5ed-a8b8-4fd9-a902-14af9c68087b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:05.626427 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-04e8c5ed-a8b8-4fd9-a902-14af9c68087b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Calling delete_port for 802e1a48-f360-4544-b1c7-4ffe24ce9585 owned by network:floatingip {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:24:05.635195 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 3a14f879-20b5-41bd-b3be-a801454d0987 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:24:05.685509 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 3a14f879-20b5-41bd-b3be-a801454d0987 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:24:05.686178 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:05.780661 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device c6384c39-1e15-446b-98aa-e19adbecc47a up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:24:05.832703 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port c6384c39-1e15-446b-98aa-e19adbecc47a triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:24:05.835260 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:05.857149 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-04e8c5ed-a8b8-4fd9-a902-14af9c68087b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:05.902191 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04e8c5ed-a8b8-4fd9-a902-14af9c68087b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event deleted for resources: {'Port': ['ID=802e1a48-f360-4544-b1c7-4ffe24ce9585,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:05.975221 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-04e8c5ed-a8b8-4fd9-a902-14af9c68087b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for floatingip, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:05.976257 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-04e8c5ed-a8b8-4fd9-a902-14af9c68087b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:05.977461 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-04e8c5ed-a8b8-4fd9-a902-14af9c68087b tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "DELETE /v2.0/floatingips/ba992ca3-6bc4-4506-b0c1-1099a040a0fb HTTP/1.1" status: 204 len: 168 time: 0.6867840 Nov 11 17:24:06.076283 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f35cac89-4b95-47fe-9d56-647568e81403 req-5deb8f0b-d22c-4ca0-9212-6fea33bc0f75 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 210 time: 0.0599267 Nov 11 17:24:06.358664 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:07.009882 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:07.169739 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-87bff80c-56dc-417f-a726-37abca9a8c8d req-3166c772-02bd-496f-a3ee-7e839dd12a79 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 210 time: 0.0264921 Nov 11 17:24:07.247493 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-d59e2bc2-9534-4a2b-bc8c-953b31b9c218 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:07.248821 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-d59e2bc2-9534-4a2b-bc8c-953b31b9c218 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.10 "GET /v2.0/networks?id=0d49ad27-76fe-421c-86d6-138a53bc5d1c HTTP/1.1" status: 200 len: 815 time: 0.1105630 Nov 11 17:24:07.266084 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-347a4f18-1ba0-4110-9c22-4a169d5fcfab tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Request body: {'port': {'device_id': '4ebd58e3-5acf-4516-bc24-5105ba5333e9', 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c', 'admin_state_up': True, 'tenant_id': 'c02f323bd05c4d6bbbadfb2cf91bd62d'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:24:07.339849 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 37026) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:07.402780 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-558be43d-ea10-4184-9a2e-820e9323ad0e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:07.429174 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-558be43d-ea10-4184-9a2e-820e9323ad0e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:07.461404 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-347a4f18-1ba0-4110-9c22-4a169d5fcfab tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Made reservation on behalf of c02f323bd05c4d6bbbadfb2cf91bd62d for: {'port': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:24:07.465428 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-347a4f18-1ba0-4110-9c22-4a169d5fcfab tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:07.598831 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-558be43d-ea10-4184-9a2e-820e9323ad0e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:07.601766 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-558be43d-ea10-4184-9a2e-820e9323ad0e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:07.603065 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-558be43d-ea10-4184-9a2e-820e9323ad0e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] 10.222.0.16 "DELETE /v2.0/security-groups/a3fcdc84-afa7-461b-8091-b146ab222f62 HTTP/1.1" status: 204 len: 168 time: 0.2621484 Nov 11 17:24:07.613710 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-558be43d-ea10-4184-9a2e-820e9323ad0e tempest-TestVolumeBootPattern-1659813868 tempest-TestVolumeBootPattern-1659813868-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a3fcdc84-afa7-461b-8091-b146ab222f62,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:07.743487 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 37036) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:07.883694 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-347a4f18-1ba0-4110-9c22-4a169d5fcfab tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Allocated IP 172.20.0.9 (0d49ad27-76fe-421c-86d6-138a53bc5d1c/92bc39c3-f62a-4a09-b809-9f253b9c7487/7fedd3c1-82af-4b49-98ea-55b8dad33ff9) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:24:08.163370 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-347a4f18-1ba0-4110-9c22-4a169d5fcfab tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:08.264792 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-6bc06934-5fb8-4f35-95f5-a553c7a05408 req-0ef9fb63-1f48-49df-9f8d-309601ca29bc tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 210 time: 0.0272677 Nov 11 17:24:08.321654 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-347a4f18-1ba0-4110-9c22-4a169d5fcfab tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:08.338294 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['70e42819-0a8f-45db-bd4b-b7af772f04ec', '6176c69f-e97f-44c0-93d8-bad69dcaac9c'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:24:08.384680 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-347a4f18-1ba0-4110-9c22-4a169d5fcfab tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Network 0d49ad27-76fe-421c-86d6-138a53bc5d1c is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:24:08.398697 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-347a4f18-1ba0-4110-9c22-4a169d5fcfab tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:24:08.404950 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-347a4f18-1ba0-4110-9c22-4a169d5fcfab tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:24:08.412519 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-347a4f18-1ba0-4110-9c22-4a169d5fcfab tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Pushing event updated for resources: {'Port': ['ID=7fedd3c1-82af-4b49-98ea-55b8dad33ff9,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:08.526768 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-347a4f18-1ba0-4110-9c22-4a169d5fcfab tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:08.527515 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-347a4f18-1ba0-4110-9c22-4a169d5fcfab tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:08.580216 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-49b115c3-e6a3-4c43-8601-0c007648d226 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-394221'] for router_interface, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:08.620130 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-347a4f18-1ba0-4110-9c22-4a169d5fcfab tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3578348 Nov 11 17:24:08.637440 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Request body: {'port': {'device_id': '4ebd58e3-5acf-4516-bc24-5105ba5333e9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:24:08.748727 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:09.096797 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-49b115c3-e6a3-4c43-8601-0c007648d226 admin admin] Deleting port 170b88c1-ded4-4c5e-a307-63d78d797a5c {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:24:09.097132 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-49b115c3-e6a3-4c43-8601-0c007648d226 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:09.197709 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 {{(pid=102324) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:24:09.208211 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:09.227525 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [None req-49b115c3-e6a3-4c43-8601-0c007648d226 admin admin] For port 170b88c1-ded4-4c5e-a307-63d78d797a5c, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=170b88c1-ded4-4c5e-a307-63d78d797a5c,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:09.227883 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-49b115c3-e6a3-4c43-8601-0c007648d226 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:09.243879 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.provisioning_blocks [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Transition to ACTIVE for port object 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 will not be triggered until provisioned by entity L2. {{(pid=102324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:24:09.244852 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-49b115c3-e6a3-4c43-8601-0c007648d226 admin admin] Calling delete_port for 170b88c1-ded4-4c5e-a307-63d78d797a5c owned by network:router_interface {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:24:09.313467 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:09.448963 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Pushing event updated for resources: {'Port': ['ID=7fedd3c1-82af-4b49-98ea-55b8dad33ff9,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:09.484185 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14ef3218-0bd8-4667-b377-873f28a44a7c req-af9ffe28-554f-4c64-a2c9-a467686ba8d7 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:09.485779 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-14ef3218-0bd8-4667-b377-873f28a44a7c req-af9ffe28-554f-4c64-a2c9-a467686ba8d7 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 943 time: 0.1384704 Nov 11 17:24:09.608329 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Attempting to bind port 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:24:09.608665 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Attempting to bind port 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:24:09.608997 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Attempting to bind port 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 on network 0d49ad27-76fe-421c-86d6-138a53bc5d1c {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:24:09.616474 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Port 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 on network 0d49ad27-76fe-421c-86d6-138a53bc5d1c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:24:09.616794 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Attempting to bind port 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 on network 0d49ad27-76fe-421c-86d6-138a53bc5d1c {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:24:09.622322 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-14ef3218-0bd8-4667-b377-873f28a44a7c req-9ce1bcbc-5bd0-43ad-b9af-8c4a774288b8 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1154737 Nov 11 17:24:09.624966 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 23, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:24:09.625364 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Checking segment: {'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:24:09.625655 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Bound using segment: {'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:24:09.626092 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Bound port: 7fedd3c1-82af-4b49-98ea-55b8dad33ff9, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'}}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:24:09.626437 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:09.664041 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-49b115c3-e6a3-4c43-8601-0c007648d226 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:09.696016 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49b115c3-e6a3-4c43-8601-0c007648d226 admin admin] Pushing event deleted for resources: {'Port': ['ID=170b88c1-ded4-4c5e-a307-63d78d797a5c,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:09.761138 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] For port 7fedd3c1-82af-4b49-98ea-55b8dad33ff9, host hv-cinder-69414, cleared binding levels {{(pid=102324) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:24:09.779568 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] For port 7fedd3c1-82af-4b49-98ea-55b8dad33ff9, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=7fedd3c1-82af-4b49-98ea-55b8dad33ff9,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102324) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:24:09.870683 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:09.929505 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:09.930116 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:09.931502 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] 10.222.0.10 "PUT /v2.0/ports/7fedd3c1-82af-4b49-98ea-55b8dad33ff9 HTTP/1.1" status: 200 len: 1093 time: 1.2983415 Nov 11 17:24:09.933540 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4ebd58e3-5acf-4516-bc24-5105ba5333e9', 'tag': '7fedd3c1-82af-4b49-98ea-55b8dad33ff9'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:24:09.935838 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f5bc3585-9785-4f77-80b5-0dc976c0e17e" -d '{"events": [{"name": "network-changed", "server_uuid": "4ebd58e3-5acf-4516-bc24-5105ba5333e9", "tag": "7fedd3c1-82af-4b49-98ea-55b8dad33ff9"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:24:09.943364 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-49b115c3-e6a3-4c43-8601-0c007648d226 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8103781', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-393853'] for router_interface, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:09.960489 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c2df889-5d3c-4d57-9311-bc6421c370b8 service neutron] Pushing event updated for resources: {'Port': ['ID=7fedd3c1-82af-4b49-98ea-55b8dad33ff9,revision_number=3']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:09.998653 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:24:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-33fc1ec4-f4c2-41fa-ab5e-a049d8c2f0c7 x-openstack-request-id: req-33fc1ec4-f4c2-41fa-ab5e-a049d8c2f0c7 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:24:09.998935 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4ebd58e3-5acf-4516-bc24-5105ba5333e9", "tag": "7fedd3c1-82af-4b49-98ea-55b8dad33ff9", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:24:09.999177 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-33fc1ec4-f4c2-41fa-ab5e-a049d8c2f0c7 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:24:09.999569 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4ebd58e3-5acf-4516-bc24-5105ba5333e9', 'tag': '7fedd3c1-82af-4b49-98ea-55b8dad33ff9', 'status': 'completed', 'code': 200} Nov 11 17:24:10.108242 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5bc3585-9785-4f77-80b5-0dc976c0e17e req-16891ecf-9994-40c2-8198-b528095a5a94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:10.109736 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f5bc3585-9785-4f77-80b5-0dc976c0e17e req-16891ecf-9994-40c2-8198-b528095a5a94 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=c02f323bd05c4d6bbbadfb2cf91bd62d&device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 1096 time: 0.0997822 Nov 11 17:24:10.561157 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5bc3585-9785-4f77-80b5-0dc976c0e17e req-8f534b63-0a7a-453f-ad41-fe6baa331b06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:10.562628 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f5bc3585-9785-4f77-80b5-0dc976c0e17e req-8f534b63-0a7a-453f-ad41-fe6baa331b06 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=c02f323bd05c4d6bbbadfb2cf91bd62d&shared=False HTTP/1.1" status: 200 len: 916 time: 0.4158552 Nov 11 17:24:10.564323 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-49b115c3-e6a3-4c43-8601-0c007648d226 admin admin] Router 1267b92b-e259-4df2-9704-b862470a9e03 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:24:10.779291 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5bc3585-9785-4f77-80b5-0dc976c0e17e req-e19b71d7-a292-4fa8-bb56-21d0e7a719f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:10.780732 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f5bc3585-9785-4f77-80b5-0dc976c0e17e req-e19b71d7-a292-4fa8-bb56-21d0e7a719f8 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2097681 Nov 11 17:24:10.794979 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-49b115c3-e6a3-4c43-8601-0c007648d226 admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:24:10.802063 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-49b115c3-e6a3-4c43-8601-0c007648d226 admin admin] 10.222.0.16 "PUT /v2.0/routers/1267b92b-e259-4df2-9704-b862470a9e03/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0571873 Nov 11 17:24:10.803009 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 37054) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:10.805377 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac33fbde-057d-448c-bc14-0c5f047660e9 None None] Sync routers for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:24:10.816119 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac33fbde-057d-448c-bc14-0c5f047660e9 None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:24:10.817109 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-ac33fbde-057d-448c-bc14-0c5f047660e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:24:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:10.819151 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d33e035-5e70-47ad-a2f9-535561613843 req-37b2761a-07ed-4658-a687-07ebc8bbafce tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:10.821147 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1d33e035-5e70-47ad-a2f9-535561613843 req-37b2761a-07ed-4658-a687-07ebc8bbafce tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 943 time: 0.1051996 Nov 11 17:24:10.910394 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1d33e035-5e70-47ad-a2f9-535561613843 req-33dd8d1d-d5e4-44cb-8549-8b1900bd5589 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0816143 Nov 11 17:24:10.917891 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-0de8c450-dccc-4b18-bc9b-b200a33527ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:10.919801 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-0de8c450-dccc-4b18-bc9b-b200a33527ab service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=c02f323bd05c4d6bbbadfb2cf91bd62d&device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 1096 time: 0.0893257 Nov 11 17:24:10.973753 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-2abc8599-4d2f-4c9f-839d-70172b28a9b4 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7fedd3c1-82af-4b49-98ea-55b8dad33ff9 HTTP/1.1" status: 200 len: 217 time: 0.0423496 Nov 11 17:24:11.034116 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-af07735e-bff4-4c39-86fa-35e17509a21b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:11.035772 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-af07735e-bff4-4c39-86fa-35e17509a21b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=92bc39c3-f62a-4a09-b809-9f253b9c7487 HTTP/1.1" status: 200 len: 855 time: 0.0533433 Nov 11 17:24:11.068466 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-ac33fbde-057d-448c-bc14-0c5f047660e9 None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:24:11.081186 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-07956866-84d5-4994-8713-dd0e0880cecb service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=0d49ad27-76fe-421c-86d6-138a53bc5d1c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0306604 Nov 11 17:24:11.199063 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-877614ec-bf09-4bab-a171-d3fc581af09c service neutron] 10.222.0.10 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1096137 Nov 11 17:24:11.216892 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9977c751-741c-4dd1-8e46-3c4edd0c32d1 admin admin] Publish callbacks [] for router, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:11.284710 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-ac33fbde-057d-448c-bc14-0c5f047660e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:24:09Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:11.299345 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d8824ba5-97d5-44e1-82f8-33c24d2c0a5f req-d5dd7e62-eb38-4168-bb3b-c9f09a65f44a service neutron] 10.222.0.10 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0923994 Nov 11 17:24:11.319603 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac33fbde-057d-448c-bc14-0c5f047660e9 None None] Checking router: 1267b92b-e259-4df2-9704-b862470a9e03 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:24:11.323555 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9977c751-741c-4dd1-8e46-3c4edd0c32d1 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:11.328304 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac33fbde-057d-448c-bc14-0c5f047660e9 None None] Routers {'1267b92b-e259-4df2-9704-b862470a9e03'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:24:11.329049 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-ac33fbde-057d-448c-bc14-0c5f047660e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:24:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['1267b92b-e259-4df2-9704-b862470a9e03'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:11.440361 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-ac33fbde-057d-448c-bc14-0c5f047660e9 None None] Set router 1267b92b-e259-4df2-9704-b862470a9e03 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:24:11.456047 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-9977c751-741c-4dd1-8e46-3c4edd0c32d1 admin admin] Deleting port 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:24:11.456386 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9977c751-741c-4dd1-8e46-3c4edd0c32d1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:11.543111 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-9977c751-741c-4dd1-8e46-3c4edd0c32d1 admin admin] For port 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:11.543495 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9977c751-741c-4dd1-8e46-3c4edd0c32d1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:11.563174 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-9977c751-741c-4dd1-8e46-3c4edd0c32d1 admin admin] Calling delete_port for 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0 owned by network:router_gateway {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:24:11.649742 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-ac33fbde-057d-448c-bc14-0c5f047660e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:24:09Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:11.676627 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac33fbde-057d-448c-bc14-0c5f047660e9 None None] The sync data for ids ['1267b92b-e259-4df2-9704-b862470a9e03'] in dv-cinder-694140-2-iscsi is: [{'id': '1267b92b-e259-4df2-9704-b862470a9e03', 'name': 'tempest-TestVolumeBootPattern-965688447-router', 'tenant_id': '10bedfb35d1e481aa78e025489c1be2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190'}], 'enable_snat': True}, 'gw_port_id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:06Z', 'updated_at': '2021-11-11T17:24:09Z', 'revision_number': 5, 'project_id': '10bedfb35d1e481aa78e025489c1be2d', 'gw_port': {'id': '8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:5c:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1267b92b-e259-4df2-9704-b862470a9e03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:07Z', 'updated_at': '2021-11-11T17:16:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:24:11.792387 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9977c751-741c-4dd1-8e46-3c4edd0c32d1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:11.823248 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9977c751-741c-4dd1-8e46-3c4edd0c32d1 admin admin] Pushing event deleted for resources: {'Port': ['ID=8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:11.881153 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9977c751-741c-4dd1-8e46-3c4edd0c32d1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-397207'] for router_gateway, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:11.970698 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9977c751-741c-4dd1-8e46-3c4edd0c32d1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-424448', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7353'] for router, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:11.972690 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9977c751-741c-4dd1-8e46-3c4edd0c32d1 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:12.062809 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-259dc3d1-dcf0-4dce-9ad9-601b0f22e39c req-7b4a27ed-f6ac-49f8-8fec-565cf9684add tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:12.064362 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-259dc3d1-dcf0-4dce-9ad9-601b0f22e39c req-7b4a27ed-f6ac-49f8-8fec-565cf9684add tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 943 time: 0.0554259 Nov 11 17:24:12.113556 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9977c751-741c-4dd1-8e46-3c4edd0c32d1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-424459'] for router, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:12.114109 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9977c751-741c-4dd1-8e46-3c4edd0c32d1 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1267b92b-e259-4df2-9704-b862470a9e03 {{(pid=102323) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 17:24:12.122161 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-9977c751-741c-4dd1-8e46-3c4edd0c32d1 admin admin] Publish callbacks [] for router, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:12.122161 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-9977c751-741c-4dd1-8e46-3c4edd0c32d1 admin admin] 10.222.0.16 "DELETE /v2.0/routers/1267b92b-e259-4df2-9704-b862470a9e03 HTTP/1.1" status: 204 len: 168 time: 1.3176296 Nov 11 17:24:12.124931 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 37062) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:12.127713 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-259dc3d1-dcf0-4dce-9ad9-601b0f22e39c req-647736fb-da98-4280-832d-727c90b1b363 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0571520 Nov 11 17:24:12.179830 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_v2 [None req-739d28de-da50-42c0-80b0-2eabf6c8bd68 admin admin] Deleting subnet bf78c82f-f2f3-4ef7-8052-be816dbd2df8 {{(pid=102324) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:24:12.185810 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-739d28de-da50-42c0-80b0-2eabf6c8bd68 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:12.220698 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-739d28de-da50-42c0-80b0-2eabf6c8bd68 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5895837'] for subnet, precommit_delete_associations {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:12.308397 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-739d28de-da50-42c0-80b0-2eabf6c8bd68 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:12.455796 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-739d28de-da50-42c0-80b0-2eabf6c8bd68 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5436208', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5275461'] for subnet, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:12.485573 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-739d28de-da50-42c0-80b0-2eabf6c8bd68 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bf78c82f-f2f3-4ef7-8052-be816dbd2df8,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:12.494885 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-739d28de-da50-42c0-80b0-2eabf6c8bd68 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:12.495759 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-739d28de-da50-42c0-80b0-2eabf6c8bd68 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/bf78c82f-f2f3-4ef7-8052-be816dbd2df8 HTTP/1.1" status: 204 len: 168 time: 0.3683162 Nov 11 17:24:12.498145 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 37064) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:12.500453 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-953cef44-7345-457c-b921-b204d030d184 None None] Network 45e6626a-2007-490b-a445-d7c3baea689e requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:24:12.591360 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:12.652729 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] Deleting port fbbd6ac9-227d-4975-bedc-d7f706997b8d {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:24:12.653067 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:12.725549 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45a07eca-dec7-425c-bcfa-0645b7669bc7 None None] DHCP port deletion for 45e6626a-2007-490b-a445-d7c3baea689e request from dv-cinder-694140-2-iscsi {{(pid=102325) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 11 17:24:12.729397 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] For port fbbd6ac9-227d-4975-bedc-d7f706997b8d, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=fbbd6ac9-227d-4975-bedc-d7f706997b8d,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:12.729782 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:12.753266 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] Calling delete_port for fbbd6ac9-227d-4975-bedc-d7f706997b8d owned by network:dhcp {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:24:12.776354 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-45a07eca-dec7-425c-bcfa-0645b7669bc7 None None] Deleting port fbbd6ac9-227d-4975-bedc-d7f706997b8d {{(pid=102325) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:24:12.776726 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-45a07eca-dec7-425c-bcfa-0645b7669bc7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:12.847151 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-45a07eca-dec7-425c-bcfa-0645b7669bc7 None None] For port fbbd6ac9-227d-4975-bedc-d7f706997b8d, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=fbbd6ac9-227d-4975-bedc-d7f706997b8d,segment=NetworkSegment(8ac7fd42-d3df-4810-add0-6e5903972d61),segment_id=8ac7fd42-d3df-4810-add0-6e5903972d61)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:12.847543 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-45a07eca-dec7-425c-bcfa-0645b7669bc7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:12.861363 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-45a07eca-dec7-425c-bcfa-0645b7669bc7 None None] Calling delete_port for fbbd6ac9-227d-4975-bedc-d7f706997b8d owned by network:dhcp {{(pid=102325) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:24:12.900161 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:12.928291 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] No DVR routers for this DVR port fbbd6ac9-227d-4975-bedc-d7f706997b8d on host dv-cinder-694140-2-iscsi {{(pid=102323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:24:12.932163 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] Pushing event deleted for resources: {'Port': ['ID=fbbd6ac9-227d-4975-bedc-d7f706997b8d,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:12.942165 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-45a07eca-dec7-425c-bcfa-0645b7669bc7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633'] for port, after_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:12.967704 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45a07eca-dec7-425c-bcfa-0645b7669bc7 None None] Pushing event deleted for resources: {'Port': ['ID=fbbd6ac9-227d-4975-bedc-d7f706997b8d,revision_number=None']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:12.971291 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45a07eca-dec7-425c-bcfa-0645b7669bc7 None None] No DVR routers for this DVR port fbbd6ac9-227d-4975-bedc-d7f706997b8d on host dv-cinder-694140-2-iscsi {{(pid=102325) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:24:13.006933 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:13.027324 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['45e6626a-2007-490b-a445-d7c3baea689e']}} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:13.036490 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8ac7fd42-d3df-4810-add0-6e5903972d61') {'for_net_delete': True} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:13.036810 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8ac7fd42-d3df-4810-add0-6e5903972d61') {} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:13.046634 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5777070'] for segment, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:13.059672 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:13.065491 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] Releasing vlan 505 on physical network physnet1 to pool {{(pid=102323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:24:13.065869 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5720605'] for segment, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: Traceback (most recent call last): Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: timer() Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: cb(*args, **kw) Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: return func(*args, **kwargs) Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: self._notify() Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: self.callback(batched_events) Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: event.method(event) Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: return f(self, *a, **k) Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._get(url).json() Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: return self.request(url, 'GET', **kwargs) Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:24:13.067570 dv-cinder-694140-2-iscsi neutron-server[102323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:24:13.215229 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:13.219549 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:13.225692 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] 10.222.0.16 "DELETE /v2.0/networks/45e6626a-2007-490b-a445-d7c3baea689e HTTP/1.1" status: 204 len: 168 time: 0.7260058 Nov 11 17:24:13.228728 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 37070) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:13.246047 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64f3ea84-1379-4c6b-9adf-343542d1e5aa admin admin] Pushing event deleted for resources: {'Network': ['ID=45e6626a-2007-490b-a445-d7c3baea689e,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:13.250144 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-448f83c5-9f52-480f-b7b0-eb52438ec19b req-729fda07-1016-4ea6-90db-d8c47f156c7b tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:13.251635 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-448f83c5-9f52-480f-b7b0-eb52438ec19b req-729fda07-1016-4ea6-90db-d8c47f156c7b tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 943 time: 0.0533834 Nov 11 17:24:13.305858 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-448f83c5-9f52-480f-b7b0-eb52438ec19b req-8bb85745-1ed3-43d4-8c31-27781fd8a858 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476167 Nov 11 17:24:13.609150 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0 no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:24:13.610043 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-aa2db0d9-4fda-40ad-bf93-97feaa22d0fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-394221'] for router_interface, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:13.634009 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:24:13.634351 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 8c9ec2e9-adf5-4cc4-a5ef-124bb3bab7e0 not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:24:13.634790 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device fbbd6ac9-227d-4975-bedc-d7f706997b8d no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:24:13.656694 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: fbbd6ac9-227d-4975-bedc-d7f706997b8d {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:24:13.657039 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device fbbd6ac9-227d-4975-bedc-d7f706997b8d not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:24:13.657461 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 170b88c1-ded4-4c5e-a307-63d78d797a5c no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:24:13.676589 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: 170b88c1-ded4-4c5e-a307-63d78d797a5c {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:24:13.676936 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 170b88c1-ded4-4c5e-a307-63d78d797a5c not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:24:13.863365 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-aa2db0d9-4fda-40ad-bf93-97feaa22d0fd admin admin] Deleting port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:24:13.863706 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-aa2db0d9-4fda-40ad-bf93-97feaa22d0fd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:13.944094 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-aa2db0d9-4fda-40ad-bf93-97feaa22d0fd admin admin] For port 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf,segment=NetworkSegment(5cee43f7-3e92-4b3d-a674-c03de2d33f3f),segment_id=5cee43f7-3e92-4b3d-a674-c03de2d33f3f)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:13.944807 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-aa2db0d9-4fda-40ad-bf93-97feaa22d0fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:13.957091 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-aa2db0d9-4fda-40ad-bf93-97feaa22d0fd admin admin] Calling delete_port for 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf owned by network:router_interface {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:24:14.209191 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-aa2db0d9-4fda-40ad-bf93-97feaa22d0fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:14.242313 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa2db0d9-4fda-40ad-bf93-97feaa22d0fd admin admin] Pushing event deleted for resources: {'Port': ['ID=3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:14.436843 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-aa2db0d9-4fda-40ad-bf93-97feaa22d0fd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8103781', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-393853'] for router_interface, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:14.455989 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95ee56e2-bf9c-40ee-8961-c498c4b875af req-695dd787-8ca3-4142-be2a-586b422d7bc2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:14.457803 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-95ee56e2-bf9c-40ee-8961-c498c4b875af req-695dd787-8ca3-4142-be2a-586b422d7bc2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 943 time: 0.0722942 Nov 11 17:24:14.527837 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:24:14.590910 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-95ee56e2-bf9c-40ee-8961-c498c4b875af req-08ae1c09-88c7-4029-9cae-1f4bfaeeff28 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0916951 Nov 11 17:24:14.635225 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 7fedd3c1-82af-4b49-98ea-55b8dad33ff9, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=7fedd3c1-82af-4b49-98ea-55b8dad33ff9,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:14.647939 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '7fedd3c1-82af-4b49-98ea-55b8dad33ff9', 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c', 'port_id': '7fedd3c1-82af-4b49-98ea-55b8dad33ff9', 'mac_address': 'fa:16:3e:a3:e5:70', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 515, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '92bc39c3-f62a-4a09-b809-9f253b9c7487', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:24:14.684486 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:14.698116 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:24:14.713541 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aa2db0d9-4fda-40ad-bf93-97feaa22d0fd admin admin] Router c57ce69e-511d-472d-8e28-4e3c54622775 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:24:14.722057 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 7fedd3c1-82af-4b49-98ea-55b8dad33ff9, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=7fedd3c1-82af-4b49-98ea-55b8dad33ff9,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:14.803674 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:14.824767 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa2db0d9-4fda-40ad-bf93-97feaa22d0fd admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:24:14.829989 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-aa2db0d9-4fda-40ad-bf93-97feaa22d0fd admin admin] 10.222.0.16 "PUT /v2.0/routers/c57ce69e-511d-472d-8e28-4e3c54622775/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5982218 Nov 11 17:24:14.832830 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 37078) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:14.836092 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59e506a6-cc63-4a29-bcd8-00215d47dd4a None None] Sync routers for ids ['c57ce69e-511d-472d-8e28-4e3c54622775'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:24:14.847842 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59e506a6-cc63-4a29-bcd8-00215d47dd4a None None] Routers {'c57ce69e-511d-472d-8e28-4e3c54622775'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:24:14.849142 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-59e506a6-cc63-4a29-bcd8-00215d47dd4a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:24:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['c57ce69e-511d-472d-8e28-4e3c54622775'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:14.860403 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=7fedd3c1-82af-4b49-98ea-55b8dad33ff9,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:14.944670 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0f2ff2e7-d5c9-4a4c-a578-c17f3c5297ac admin admin] Publish callbacks [] for router, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:14.969621 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-59e506a6-cc63-4a29-bcd8-00215d47dd4a None None] Set router c57ce69e-511d-472d-8e28-4e3c54622775 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:24:15.054437 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0f2ff2e7-d5c9-4a4c-a578-c17f3c5297ac admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:15.055941 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['7fedd3c1-82af-4b49-98ea-55b8dad33ff9'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:24:15.166653 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-0f2ff2e7-d5c9-4a4c-a578-c17f3c5297ac admin admin] Deleting port 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4 {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:24:15.166837 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0f2ff2e7-d5c9-4a4c-a578-c17f3c5297ac admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:15.272840 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [None req-0f2ff2e7-d5c9-4a4c-a578-c17f3c5297ac admin admin] For port 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=6699bf5b-f6f9-4665-b1ea-b301a8acd3b4,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:15.273108 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0f2ff2e7-d5c9-4a4c-a578-c17f3c5297ac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:15.290589 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-0f2ff2e7-d5c9-4a4c-a578-c17f3c5297ac admin admin] Calling delete_port for 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4 owned by network:router_gateway {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:24:15.295181 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-59e506a6-cc63-4a29-bcd8-00215d47dd4a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'name': 'tempest-TestVolumeBootPattern-354798896-router', 'tenant_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.66'}], 'enable_snat': True}, 'gw_port_id': '6699bf5b-f6f9-4665-b1ea-b301a8acd3b4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:16Z', 'updated_at': '2021-11-11T17:24:14Z', 'revision_number': 5, 'project_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'gw_port': {'id': '6699bf5b-f6f9-4665-b1ea-b301a8acd3b4', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:5a:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'device_owner': 'network:router_gateway', 'standard_attr_id': 438, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:16:17Z', 'updated_at': '2021-11-11T17:16:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:15.324184 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59e506a6-cc63-4a29-bcd8-00215d47dd4a None None] Checking router: c57ce69e-511d-472d-8e28-4e3c54622775 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:24:15.333435 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59e506a6-cc63-4a29-bcd8-00215d47dd4a None None] Routers {'c57ce69e-511d-472d-8e28-4e3c54622775'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:24:15.334626 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-59e506a6-cc63-4a29-bcd8-00215d47dd4a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:24:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['c57ce69e-511d-472d-8e28-4e3c54622775'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:15.422372 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-59e506a6-cc63-4a29-bcd8-00215d47dd4a None None] Set router c57ce69e-511d-472d-8e28-4e3c54622775 gateway port host: None {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:24:15.474948 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-59e506a6-cc63-4a29-bcd8-00215d47dd4a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'name': 'tempest-TestVolumeBootPattern-354798896-router', 'tenant_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:16Z', 'updated_at': '2021-11-11T17:24:15Z', 'revision_number': 6, 'project_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'gw_port_host': None}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:15.504714 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59e506a6-cc63-4a29-bcd8-00215d47dd4a None None] The sync data for ids ['c57ce69e-511d-472d-8e28-4e3c54622775'] in dv-cinder-694140-2-iscsi is: [{'id': 'c57ce69e-511d-472d-8e28-4e3c54622775', 'name': 'tempest-TestVolumeBootPattern-354798896-router', 'tenant_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:16:16Z', 'updated_at': '2021-11-11T17:24:15Z', 'revision_number': 6, 'project_id': 'ab572ed9fb234e2eb59dd278b16bf840', 'gw_port_host': None}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:24:15.557800 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0f2ff2e7-d5c9-4a4c-a578-c17f3c5297ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:15.585537 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f2ff2e7-d5c9-4a4c-a578-c17f3c5297ac admin admin] Pushing event deleted for resources: {'Port': ['ID=6699bf5b-f6f9-4665-b1ea-b301a8acd3b4,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:15.665029 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0f2ff2e7-d5c9-4a4c-a578-c17f3c5297ac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-397207'] for router_gateway, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:15.777114 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0f2ff2e7-d5c9-4a4c-a578-c17f3c5297ac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-424448', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7353'] for router, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:15.779499 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0f2ff2e7-d5c9-4a4c-a578-c17f3c5297ac admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:15.899918 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ae767e7-7ccc-4998-9fdb-4a248956b264 req-6163b0e6-75b9-48dc-999f-5563d0a1d2ef tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:15.907154 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6ae767e7-7ccc-4998-9fdb-4a248956b264 req-6163b0e6-75b9-48dc-999f-5563d0a1d2ef tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 944 time: 0.2206700 Nov 11 17:24:15.942073 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0f2ff2e7-d5c9-4a4c-a578-c17f3c5297ac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-424459'] for router, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:15.942728 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f2ff2e7-d5c9-4a4c-a578-c17f3c5297ac admin admin] Fanout notify agent at l3_agent the message router_deleted on router c57ce69e-511d-472d-8e28-4e3c54622775 {{(pid=102324) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 17:24:15.959919 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0f2ff2e7-d5c9-4a4c-a578-c17f3c5297ac admin admin] Publish callbacks [] for router, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:15.961238 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-0f2ff2e7-d5c9-4a4c-a578-c17f3c5297ac admin admin] 10.222.0.16 "DELETE /v2.0/routers/c57ce69e-511d-472d-8e28-4e3c54622775 HTTP/1.1" status: 204 len: 168 time: 1.1273556 Nov 11 17:24:15.963897 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 37086) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:15.969860 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6ae767e7-7ccc-4998-9fdb-4a248956b264 req-6ff3f465-3a49-4339-bc96-f5a75a896912 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619001 Nov 11 17:24:15.998682 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:24:16.019560 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:24:16.019904 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 3c70ef4c-f13f-4bb4-a2e8-4d06e8f5fedf not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:24:16.061368 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_v2 [None req-5ce9811e-7015-49ec-bc99-7fc5a073b0a8 admin admin] Deleting subnet 3ff29672-2a30-4e62-8d64-1fc0068451f0 {{(pid=102323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:24:16.066329 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5ce9811e-7015-49ec-bc99-7fc5a073b0a8 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:16.135695 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5ce9811e-7015-49ec-bc99-7fc5a073b0a8 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5777079'] for subnet, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:16.280940 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5ce9811e-7015-49ec-bc99-7fc5a073b0a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:16.420991 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5ce9811e-7015-49ec-bc99-7fc5a073b0a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5720643', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5388326'] for subnet, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:16.450217 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ce9811e-7015-49ec-bc99-7fc5a073b0a8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3ff29672-2a30-4e62-8d64-1fc0068451f0,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:16.454148 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5ce9811e-7015-49ec-bc99-7fc5a073b0a8 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:16.457806 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-5ce9811e-7015-49ec-bc99-7fc5a073b0a8 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/3ff29672-2a30-4e62-8d64-1fc0068451f0 HTTP/1.1" status: 204 len: 168 time: 0.4923308 Nov 11 17:24:16.463571 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae212cd4-ce2e-4843-a62d-4c1808ef7339 None None] Network d863ef72-568a-44c9-9174-02dbf417bf28 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:24:16.466943 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 37088) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:16.545312 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:24:16.547679 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:16.615506 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] Deleting port 819a44ba-1b06-406f-bec0-46cb9e3bc564 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:24:16.615836 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:16.703892 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] For port 819a44ba-1b06-406f-bec0-46cb9e3bc564, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=819a44ba-1b06-406f-bec0-46cb9e3bc564,segment=NetworkSegment(5cee43f7-3e92-4b3d-a674-c03de2d33f3f),segment_id=5cee43f7-3e92-4b3d-a674-c03de2d33f3f)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:16.704250 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:16.720551 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] Calling delete_port for 819a44ba-1b06-406f-bec0-46cb9e3bc564 owned by network:dhcp {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:24:16.723543 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:24:16.728394 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:24:16.728799 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:16.731865 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f51a413-67d1-44c7-837a-0a50c8a1c87c None None] DHCP port deletion for d863ef72-568a-44c9-9174-02dbf417bf28 request from dv-cinder-694140-2-iscsi {{(pid=102325) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 11 17:24:16.837686 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-5f51a413-67d1-44c7-837a-0a50c8a1c87c None None] Deleting port 819a44ba-1b06-406f-bec0-46cb9e3bc564 {{(pid=102325) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:24:16.838069 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-5f51a413-67d1-44c7-837a-0a50c8a1c87c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:16.855074 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:16.883853 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] No DVR routers for this DVR port 819a44ba-1b06-406f-bec0-46cb9e3bc564 on host dv-cinder-694140-2-iscsi {{(pid=102323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:24:16.885513 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] Pushing event deleted for resources: {'Port': ['ID=819a44ba-1b06-406f-bec0-46cb9e3bc564,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:16.911574 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:16.937200 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-5f51a413-67d1-44c7-837a-0a50c8a1c87c None None] For port 819a44ba-1b06-406f-bec0-46cb9e3bc564, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=819a44ba-1b06-406f-bec0-46cb9e3bc564,segment=NetworkSegment(5cee43f7-3e92-4b3d-a674-c03de2d33f3f),segment_id=5cee43f7-3e92-4b3d-a674-c03de2d33f3f)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:16.937590 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-5f51a413-67d1-44c7-837a-0a50c8a1c87c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:16.965266 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ebd58e3-5acf-4516-bc24-5105ba5333e9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7fedd3c1-82af-4b49-98ea-55b8dad33ff9'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:24:16.967669 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-97fe25de-3c1d-4b9d-af63-10b27b22e9e3" -d '{"events": [{"server_uuid": "4ebd58e3-5acf-4516-bc24-5105ba5333e9", "name": "network-vif-plugged", "status": "completed", "tag": "7fedd3c1-82af-4b49-98ea-55b8dad33ff9"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:24:16.970126 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:16.972484 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-5f51a413-67d1-44c7-837a-0a50c8a1c87c None None] Calling delete_port for 819a44ba-1b06-406f-bec0-46cb9e3bc564 owned by network:dhcp {{(pid=102325) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:24:16.985731 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:16.989863 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 7fedd3c1-82af-4b49-98ea-55b8dad33ff9, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=7fedd3c1-82af-4b49-98ea-55b8dad33ff9,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:16.998942 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d863ef72-568a-44c9-9174-02dbf417bf28']}} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:17.018769 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5cee43f7-3e92-4b3d-a674-c03de2d33f3f') {'for_net_delete': True} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:17.018769 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5cee43f7-3e92-4b3d-a674-c03de2d33f3f') {} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:17.026618 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:24:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1776f2da-f333-4245-bd39-1b2c218618f6 x-openstack-request-id: req-1776f2da-f333-4245-bd39-1b2c218618f6 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:24:17.027191 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ebd58e3-5acf-4516-bc24-5105ba5333e9", "name": "network-vif-plugged", "status": "completed", "tag": "7fedd3c1-82af-4b49-98ea-55b8dad33ff9", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:24:17.027191 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-1776f2da-f333-4245-bd39-1b2c218618f6 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:24:17.027529 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ebd58e3-5acf-4516-bc24-5105ba5333e9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7fedd3c1-82af-4b49-98ea-55b8dad33ff9', 'code': 200} Nov 11 17:24:17.031635 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5777070'] for segment, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:17.046796 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:17.055394 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] Releasing vlan 507 on physical network physnet1 to pool {{(pid=102323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:24:17.063226 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5720605'] for segment, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: Traceback (most recent call last): Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: timer() Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: cb(*args, **kw) Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: return func(*args, **kwargs) Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: self._notify() Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: self.callback(batched_events) Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: event.method(event) Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: return f(self, *a, **k) Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._get(url).json() Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: return self.request(url, 'GET', **kwargs) Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:24:17.065304 dv-cinder-694140-2-iscsi neutron-server[102323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:24:17.074280 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:17.086440 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-5f51a413-67d1-44c7-837a-0a50c8a1c87c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633'] for port, after_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:17.123488 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f51a413-67d1-44c7-837a-0a50c8a1c87c None None] No DVR routers for this DVR port 819a44ba-1b06-406f-bec0-46cb9e3bc564 on host dv-cinder-694140-2-iscsi {{(pid=102325) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:24:17.144806 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e06dccd-6711-4b1d-8968-8f28b1886f52 req-c4f62e6c-fc1a-42f1-9061-3b9cad1198fc tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:17.146332 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1e06dccd-6711-4b1d-8968-8f28b1886f52 req-c4f62e6c-fc1a-42f1-9061-3b9cad1198fc tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 945 time: 0.0655603 Nov 11 17:24:17.148963 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=7fedd3c1-82af-4b49-98ea-55b8dad33ff9,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:17.187453 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f51a413-67d1-44c7-837a-0a50c8a1c87c None None] Pushing event deleted for resources: {'Port': ['ID=819a44ba-1b06-406f-bec0-46cb9e3bc564,revision_number=None']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:17.192285 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:17.199581 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1e06dccd-6711-4b1d-8968-8f28b1886f52 req-5149e353-ab36-4307-9c94-019b733d8d36 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462639 Nov 11 17:24:17.210781 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:17.214032 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] 10.222.0.16 "DELETE /v2.0/networks/d863ef72-568a-44c9-9174-02dbf417bf28 HTTP/1.1" status: 204 len: 168 time: 0.7459211 Nov 11 17:24:17.215094 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4be29826-8daa-412a-84d0-a4605957560f admin admin] Pushing event deleted for resources: {'Network': ['ID=d863ef72-568a-44c9-9174-02dbf417bf28,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:17.350078 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38bd93c9-a6fa-4a1b-9a90-80a3560df9a2 req-aeb9d333-0747-4691-846b-c432da16efeb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:17.351683 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-38bd93c9-a6fa-4a1b-9a90-80a3560df9a2 req-aeb9d333-0747-4691-846b-c432da16efeb service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 1098 time: 0.0409510 Nov 11 17:24:17.402000 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-38bd93c9-a6fa-4a1b-9a90-80a3560df9a2 req-ef4fd67f-12bf-43c1-94b3-dfe9873fa849 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423112 Nov 11 17:24:17.570921 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 37102) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:17.597134 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 819a44ba-1b06-406f-bec0-46cb9e3bc564 no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:24:17.616174 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-4f7e6f3e-ab3f-4842-b726-d81d39b7764f admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=10bedfb35d1e481aa78e025489c1be2d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0428004 Nov 11 17:24:17.619039 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: 819a44ba-1b06-406f-bec0-46cb9e3bc564 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:24:17.619391 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 819a44ba-1b06-406f-bec0-46cb9e3bc564 not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:24:17.619824 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4 no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:24:17.622073 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 37104) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:17.641335 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:24:17.641679 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 6699bf5b-f6f9-4665-b1ea-b301a8acd3b4 not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:24:17.673607 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-56bf09d5-e94f-4a17-bd84-4498cea86c9d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:17.696766 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-56bf09d5-e94f-4a17-bd84-4498cea86c9d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:17.804183 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-56bf09d5-e94f-4a17-bd84-4498cea86c9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:17.806780 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-56bf09d5-e94f-4a17-bd84-4498cea86c9d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:17.807907 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-56bf09d5-e94f-4a17-bd84-4498cea86c9d admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/a6431c11-5ada-4415-a616-91b316b8bb56 HTTP/1.1" status: 204 len: 168 time: 0.1846316 Nov 11 17:24:17.815833 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56bf09d5-e94f-4a17-bd84-4498cea86c9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6431c11-5ada-4415-a616-91b316b8bb56,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:18.335775 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-378e5fd0-662d-4fc6-8a05-4259ea05ce0c req-09d927a6-35f7-4884-80d8-b654226632c8 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:18.337473 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-378e5fd0-662d-4fc6-8a05-4259ea05ce0c req-09d927a6-35f7-4884-80d8-b654226632c8 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 945 time: 0.0598748 Nov 11 17:24:18.397895 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-378e5fd0-662d-4fc6-8a05-4259ea05ce0c req-feb6a1d1-fc8b-4788-b5dc-c5b2792af483 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537117 Nov 11 17:24:18.432910 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 37122) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:18.483379 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-04b83c35-00d9-49fe-ba81-ee3e8fe2be9c admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=ab572ed9fb234e2eb59dd278b16bf840&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0489652 Nov 11 17:24:18.485954 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 37124) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:18.552323 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-2b35f7e6-f75e-4d13-83db-cc63426e41d5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:18.579224 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-2b35f7e6-f75e-4d13-83db-cc63426e41d5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:18.707016 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-2b35f7e6-f75e-4d13-83db-cc63426e41d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:18.710224 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-2b35f7e6-f75e-4d13-83db-cc63426e41d5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:18.711462 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-2b35f7e6-f75e-4d13-83db-cc63426e41d5 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/2c53aca1-c8db-4cf7-bab4-7e6fee412470 HTTP/1.1" status: 204 len: 168 time: 0.2244110 Nov 11 17:24:18.719986 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b35f7e6-f75e-4d13-83db-cc63426e41d5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c53aca1-c8db-4cf7-bab4-7e6fee412470,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:19.530135 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28936abf-0c62-4be7-9ed9-aaecadd5eac5 req-e648db0d-ce96-4b8c-917c-83a59bbbd9cb tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:19.531595 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-28936abf-0c62-4be7-9ed9-aaecadd5eac5 req-e648db0d-ce96-4b8c-917c-83a59bbbd9cb tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 945 time: 0.0495822 Nov 11 17:24:19.580620 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-28936abf-0c62-4be7-9ed9-aaecadd5eac5 req-956eaeb8-5265-4585-9f2e-d5421d40f95c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431774 Nov 11 17:24:22.258966 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-597d856e-2df6-4e9b-aabe-23f040bab1a8 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-267284263&fields=id&tenant_id=53c4ca7574da4b2a868a39a52a98e620 HTTP/1.1" status: 200 len: 267 time: 0.0512140 Nov 11 17:24:22.382034 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-4c20fa9b-5b29-4413-ad3c-fdd552ba5511 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:22.383776 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-4c20fa9b-5b29-4413-ad3c-fdd552ba5511 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/networks?id=e1e04a10-fb62-4a0a-a705-82de35b80b1b HTTP/1.1" status: 200 len: 809 time: 0.1157951 Nov 11 17:24:22.404645 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-51ff1528-bb0f-4b9d-bec0-0fb7aaf25017 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/quotas/53c4ca7574da4b2a868a39a52a98e620 HTTP/1.1" status: 200 len: 375 time: 0.0114865 Nov 11 17:24:22.459856 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-cfa35640-1a39-405e-95b5-c1c44a11ddee tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=53c4ca7574da4b2a868a39a52a98e620&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0489593 Nov 11 17:24:22.475846 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-b2884844-d713-49a1-a44c-d84940f3cb1c service neutron] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=102324) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 17:24:22.478288 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-b2884844-d713-49a1-a44c-d84940f3cb1c service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0056851 Nov 11 17:24:22.581069 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-34614f11-efef-4e47-b46d-70a24169cb41 service neutron] 10.222.0.16 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0974638 Nov 11 17:24:22.679015 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-c29d490f-594b-4c10-a3f6-38b6600aeec7 service neutron] 10.222.0.16 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862710 Nov 11 17:24:23.195161 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-0e9edb7e-d8a2-464b-98bb-efc515a34daa req-8dc3e9b8-4310-4ab5-af69-7ce3083d221f tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 210 time: 0.0267487 Nov 11 17:24:24.295700 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-fe666b27-e7c0-45bf-9058-30271fc501df req-91e03eee-6a38-4a64-a559-683b22bcec2a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 210 time: 0.0289605 Nov 11 17:24:25.280740 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-98eab436-ebbe-4dca-a7cf-4627a2bd9ee2 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:25.282180 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-98eab436-ebbe-4dca-a7cf-4627a2bd9ee2 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.10 "GET /v2.0/networks?id=e1e04a10-fb62-4a0a-a705-82de35b80b1b HTTP/1.1" status: 200 len: 809 time: 0.1190562 Nov 11 17:24:25.347930 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-00450ac1-0d03-4437-b307-d63ccefcfb9c tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=53c4ca7574da4b2a868a39a52a98e620 HTTP/1.1" status: 200 len: 379 time: 0.0563424 Nov 11 17:24:25.357898 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-9d6df4fa-8fae-444f-b5c9-ed77ffdae6f9 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Request body: {'port': {'device_id': '8a8298b6-d69a-409b-b494-a28f3a458069', 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'admin_state_up': True, 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'security_groups': ['b9ce3bfe-8c24-4f72-add6-2af585f671b3']}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:24:25.523114 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-9d6df4fa-8fae-444f-b5c9-ed77ffdae6f9 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Made reservation on behalf of 53c4ca7574da4b2a868a39a52a98e620 for: {'port': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:24:25.526944 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-9d6df4fa-8fae-444f-b5c9-ed77ffdae6f9 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:25.605608 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2c6c1d54-5361-49fd-be9a-7d02b7601848 req-360736bd-cc9e-4ae0-8a22-d84b03d9fd06 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 210 time: 0.2366803 Nov 11 17:24:25.652482 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-9d6df4fa-8fae-444f-b5c9-ed77ffdae6f9 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Allocated IP 172.20.0.14 (e1e04a10-fb62-4a0a-a705-82de35b80b1b/45e5a299-340d-4f14-b0eb-66727a394b7c/b4e35d20-ba9e-4d75-94f0-d6e6b8972c78) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:24:25.789577 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-9d6df4fa-8fae-444f-b5c9-ed77ffdae6f9 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:25.854161 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-9d6df4fa-8fae-444f-b5c9-ed77ffdae6f9 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:25.897259 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-9d6df4fa-8fae-444f-b5c9-ed77ffdae6f9 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Network e1e04a10-fb62-4a0a-a705-82de35b80b1b is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:24:25.900357 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-9d6df4fa-8fae-444f-b5c9-ed77ffdae6f9 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:24:25.904098 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-9d6df4fa-8fae-444f-b5c9-ed77ffdae6f9 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:24:25.927122 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d6df4fa-8fae-444f-b5c9-ed77ffdae6f9 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Pushing event updated for resources: {'Port': ['ID=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:25.962925 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-9d6df4fa-8fae-444f-b5c9-ed77ffdae6f9 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:25.963593 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-9d6df4fa-8fae-444f-b5c9-ed77ffdae6f9 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:26.044996 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-9d6df4fa-8fae-444f-b5c9-ed77ffdae6f9 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6911411 Nov 11 17:24:26.056544 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-7222291b-0c0b-4675-b876-4fc0dd6630a8 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=102324) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 17:24:26.057511 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-7222291b-0c0b-4675-b876-4fc0dd6630a8 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0052662 Nov 11 17:24:26.077612 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Request body: {'port': {'device_id': '8a8298b6-d69a-409b-b494-a28f3a458069', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:24:26.134966 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:26.151228 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-9298245f-b7d3-4949-8fdd-80ee8ee5c468 None None] Provisioning complete for port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:24:26.151851 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-9298245f-b7d3-4949-8fdd-80ee8ee5c468 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:26.186055 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-9298245f-b7d3-4949-8fdd-80ee8ee5c468 None None] Port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:24:26.411121 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 {{(pid=102324) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:24:26.423120 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:26.432193 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.provisioning_blocks [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Transition to ACTIVE for port object b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 will not be triggered until provisioned by entity L2. {{(pid=102324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:24:26.494550 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:26.547943 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Pushing event updated for resources: {'Port': ['ID=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:26.651922 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Attempting to bind port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:24:26.652226 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Attempting to bind port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '84e8dda5-3747-4e23-984b-1e3957701cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 548, 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b'}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:24:26.652548 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Attempting to bind port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 on network e1e04a10-fb62-4a0a-a705-82de35b80b1b {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:24:26.657538 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 on network e1e04a10-fb62-4a0a-a705-82de35b80b1b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:24:26.657818 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Attempting to bind port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 on network e1e04a10-fb62-4a0a-a705-82de35b80b1b {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:24:26.664777 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 24, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:24:26.665272 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Checking segment: {'id': '84e8dda5-3747-4e23-984b-1e3957701cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 548, 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:24:26.665812 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Bound using segment: {'id': '84e8dda5-3747-4e23-984b-1e3957701cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 548, 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b'} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:24:26.666336 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Bound port: b4e35d20-ba9e-4d75-94f0-d6e6b8972c78, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '84e8dda5-3747-4e23-984b-1e3957701cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 548, 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b'}}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:24:26.666782 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:26.780044 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] For port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78, host hv-cinder-69414, cleared binding levels {{(pid=102324) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:24:26.788711 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ef3e01c-6313-49ea-854a-64eb8ff8eb53 req-2a3e011d-8fa4-4574-93ca-fac488fbf6c6 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:26.790172 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3ef3e01c-6313-49ea-854a-64eb8ff8eb53 req-2a3e011d-8fa4-4574-93ca-fac488fbf6c6 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0752516 Nov 11 17:24:26.791835 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] For port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,segment=NetworkSegment(84e8dda5-3747-4e23-984b-1e3957701cfb),segment_id=84e8dda5-3747-4e23-984b-1e3957701cfb)] {{(pid=102324) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:24:26.840113 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3ef3e01c-6313-49ea-854a-64eb8ff8eb53 req-a6351ba7-f74b-47f2-9d6e-f345969d8205 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439391 Nov 11 17:24:26.854775 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:26.887207 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:26.887715 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:26.889094 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] 10.222.0.10 "PUT /v2.0/ports/b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 HTTP/1.1" status: 200 len: 1094 time: 0.8157263 Nov 11 17:24:26.889526 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8a8298b6-d69a-409b-b494-a28f3a458069', 'tag': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:24:26.891779 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-acf3d9b0-0e62-4ef9-933a-f79d2d63e12f" -d '{"events": [{"name": "network-changed", "server_uuid": "8a8298b6-d69a-409b-b494-a28f3a458069", "tag": "b4e35d20-ba9e-4d75-94f0-d6e6b8972c78"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:24:26.919482 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78e189-f00a-48db-ba30-8df0a6e44862 service neutron] Pushing event updated for resources: {'Port': ['ID=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,revision_number=3']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:26.935508 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:24:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-642c1dd0-4291-47a5-a66c-dc720688af9f x-openstack-request-id: req-642c1dd0-4291-47a5-a66c-dc720688af9f {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:24:26.935803 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8a8298b6-d69a-409b-b494-a28f3a458069", "tag": "b4e35d20-ba9e-4d75-94f0-d6e6b8972c78", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:24:26.936054 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-642c1dd0-4291-47a5-a66c-dc720688af9f {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:24:26.936634 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8a8298b6-d69a-409b-b494-a28f3a458069', 'tag': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78', 'status': 'completed', 'code': 200} Nov 11 17:24:27.008052 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf3d9b0-0e62-4ef9-933a-f79d2d63e12f req-3bcf18df-c9c3-4426-af7b-ac1c8e855157 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:27.012011 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-acf3d9b0-0e62-4ef9-933a-f79d2d63e12f req-3bcf18df-c9c3-4426-af7b-ac1c8e855157 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=53c4ca7574da4b2a868a39a52a98e620&device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 1097 time: 0.0460949 Nov 11 17:24:27.113575 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf3d9b0-0e62-4ef9-933a-f79d2d63e12f req-47f90c5e-840b-4a01-be9d-4e24f71e40d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:27.115618 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-acf3d9b0-0e62-4ef9-933a-f79d2d63e12f req-47f90c5e-840b-4a01-be9d-4e24f71e40d1 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=53c4ca7574da4b2a868a39a52a98e620&shared=False HTTP/1.1" status: 200 len: 910 time: 0.0973327 Nov 11 17:24:27.208923 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf3d9b0-0e62-4ef9-933a-f79d2d63e12f req-3ef49489-aa29-4d2c-b01f-1dffc408de90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:27.210295 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-acf3d9b0-0e62-4ef9-933a-f79d2d63e12f req-3ef49489-aa29-4d2c-b01f-1dffc408de90 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0878665 Nov 11 17:24:27.287421 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-4e2d1251-ec2a-40ed-8c3b-7b988e59ca0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:27.288878 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-4e2d1251-ec2a-40ed-8c3b-7b988e59ca0f service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=53c4ca7574da4b2a868a39a52a98e620&device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 1097 time: 0.0434029 Nov 11 17:24:27.331766 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-b74f053b-9a4a-40b5-be6a-8e36b3aa9b4c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 HTTP/1.1" status: 200 len: 217 time: 0.0349169 Nov 11 17:24:27.389274 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-a0d7a8f4-7571-4ef1-aa71-9df69d17dcf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:27.390749 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-a0d7a8f4-7571-4ef1-aa71-9df69d17dcf8 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=45e5a299-340d-4f14-b0eb-66727a394b7c HTTP/1.1" status: 200 len: 848 time: 0.0524936 Nov 11 17:24:27.440687 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-41b87dab-9b99-424d-b4ef-01b3bbda6ea6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:27.442202 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-41b87dab-9b99-424d-b4ef-01b3bbda6ea6 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=e1e04a10-fb62-4a0a-a705-82de35b80b1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0441520 Nov 11 17:24:27.533023 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-cffaa3b3-4263-4bd8-9eb4-709fc214f1ec service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828249 Nov 11 17:24:27.631719 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5b9443d8-1816-41e7-97f1-0aa1969a23c1 req-a896955c-17df-4a6c-a8a3-80804ea61da5 service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0900280 Nov 11 17:24:27.953531 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b8b094-88dc-4a04-81ea-c488bd1e9eac req-690da772-3e9c-4f87-adf3-ddc8172ef390 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:27.955069 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-07b8b094-88dc-4a04-81ea-c488bd1e9eac req-690da772-3e9c-4f87-adf3-ddc8172ef390 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0490980 Nov 11 17:24:28.009020 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-07b8b094-88dc-4a04-81ea-c488bd1e9eac req-e4afa4f2-6525-418c-a679-ecd5d9bb74ba tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471945 Nov 11 17:24:29.131981 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14507eff-b665-4bb3-8609-fc8c09746e7a req-a02805ea-b6e1-4974-a4e6-8ca53f5a9ea5 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:29.133347 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-14507eff-b665-4bb3-8609-fc8c09746e7a req-a02805ea-b6e1-4974-a4e6-8ca53f5a9ea5 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0501990 Nov 11 17:24:29.185041 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-14507eff-b665-4bb3-8609-fc8c09746e7a req-3715d8b2-60dd-47fa-88be-82deb7080a64 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456381 Nov 11 17:24:30.302702 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-640e07ac-81f9-4c0d-99f6-5765f13bb7d7 req-cefec99a-49ee-45cf-a622-a6c10f47d05e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:30.304051 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-640e07ac-81f9-4c0d-99f6-5765f13bb7d7 req-cefec99a-49ee-45cf-a622-a6c10f47d05e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0511720 Nov 11 17:24:30.354377 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-640e07ac-81f9-4c0d-99f6-5765f13bb7d7 req-c4bc6e4e-131e-481c-9529-c93b024cff8a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441282 Nov 11 17:24:30.928750 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-45f3a31d-e1bb-4dbc-8edf-5cb87a8c754a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:31.192741 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:24:31.420509 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-4f67e559-d85d-4e34-94aa-f83a22f53c9b tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:31.422026 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-4f67e559-d85d-4e34-94aa-f83a22f53c9b tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/networks?id=0d49ad27-76fe-421c-86d6-138a53bc5d1c HTTP/1.1" status: 200 len: 815 time: 0.1088452 Nov 11 17:24:31.437018 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-7b285fb7-1aef-4937-833e-7f1e15083ab5 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/quotas/c02f323bd05c4d6bbbadfb2cf91bd62d HTTP/1.1" status: 200 len: 375 time: 0.0092304 Nov 11 17:24:31.476685 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84fe0aa3-16b4-43bf-be95-ee140f21a19d req-33eb0109-18f4-492e-be75-9c30e6c8a88a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:31.478130 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-84fe0aa3-16b4-43bf-be95-ee140f21a19d req-33eb0109-18f4-492e-be75-9c30e6c8a88a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0541992 Nov 11 17:24:31.494352 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-1ead62ca-a7b8-4649-bdaf-4442dc012100 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=c02f323bd05c4d6bbbadfb2cf91bd62d&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0505817 Nov 11 17:24:31.507023 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-c824e37b-d849-41e6-87d5-0731b5c2e366 service neutron] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=102323) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 17:24:31.508096 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-c824e37b-d849-41e6-87d5-0731b5c2e366 service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0066073 Nov 11 17:24:31.531666 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-84fe0aa3-16b4-43bf-be95-ee140f21a19d req-7a800b18-8ec6-4228-9c91-139448749311 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0472133 Nov 11 17:24:31.598816 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-541459a2-495a-4ba1-b53d-983cd7d8bff0 service neutron] 10.222.0.16 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839562 Nov 11 17:24:31.688346 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-a1707db0-4c98-4eda-a435-05f827df65fd service neutron] 10.222.0.16 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834944 Nov 11 17:24:31.931973 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-fb285f63-70f6-4c61-b453-3df0e3fbf2d9 req-b66fc1ce-12d8-458c-8521-b5032bfe1f13 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 210 time: 0.0303056 Nov 11 17:24:32.649167 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab13dff-d4cf-4c55-873f-5e102c91640d req-19d9e4dd-7cc2-4034-a70c-8f792fd2b49c tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:32.650637 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1ab13dff-d4cf-4c55-873f-5e102c91640d req-19d9e4dd-7cc2-4034-a70c-8f792fd2b49c tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0509453 Nov 11 17:24:32.701830 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1ab13dff-d4cf-4c55-873f-5e102c91640d req-4dfe2e2e-27f0-4075-b3c4-099579c81a08 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451143 Nov 11 17:24:33.030448 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-250abbca-e228-4d22-86c2-63a8bcbeadb1 req-a41eabcf-5507-4217-b46b-01d8dbfe2e58 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 210 time: 0.0271986 Nov 11 17:24:33.511222 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-d77ee9c4-1398-420b-9425-9febdb4117f2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:33.745546 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-7c5325fd-bae2-47c8-988c-6cbcc4429490 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:33.747028 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-7c5325fd-bae2-47c8-988c-6cbcc4429490 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.10 "GET /v2.0/networks?id=0d49ad27-76fe-421c-86d6-138a53bc5d1c HTTP/1.1" status: 200 len: 815 time: 0.1024005 Nov 11 17:24:33.762209 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-ac7d676d-ae26-48a2-903d-b5bd90cff9b2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Request body: {'port': {'device_id': 'cf9304b8-18c1-4c82-92e0-8bf687c4802c', 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c', 'admin_state_up': True, 'tenant_id': 'c02f323bd05c4d6bbbadfb2cf91bd62d'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:24:33.825583 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197b8ff6-65ff-408e-94b3-907022b2cbf6 req-0ecd8b3d-7610-40c2-88f0-c375355bbc46 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:33.827089 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-197b8ff6-65ff-408e-94b3-907022b2cbf6 req-0ecd8b3d-7610-40c2-88f0-c375355bbc46 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0549107 Nov 11 17:24:33.879462 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-197b8ff6-65ff-408e-94b3-907022b2cbf6 req-9996baff-c3f9-4f0b-87b8-da5c4adaeec4 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454719 Nov 11 17:24:33.928256 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-ac7d676d-ae26-48a2-903d-b5bd90cff9b2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Made reservation on behalf of c02f323bd05c4d6bbbadfb2cf91bd62d for: {'port': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:24:33.931788 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-ac7d676d-ae26-48a2-903d-b5bd90cff9b2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:34.062212 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-ac7d676d-ae26-48a2-903d-b5bd90cff9b2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Allocated IP 172.20.0.7 (0d49ad27-76fe-421c-86d6-138a53bc5d1c/92bc39c3-f62a-4a09-b809-9f253b9c7487/03261358-2e56-4bc9-a189-253e933a58f7) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:24:34.395732 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f584679f-2260-44e0-a691-06ec161e979e req-e51176dc-2ecd-4753-8943-a2a826926182 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 210 time: 0.0382860 Nov 11 17:24:34.583527 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-ac7d676d-ae26-48a2-903d-b5bd90cff9b2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:34.631435 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:34.745502 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-ac7d676d-ae26-48a2-903d-b5bd90cff9b2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:34.758254 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['70e42819-0a8f-45db-bd4b-b7af772f04ec', '6176c69f-e97f-44c0-93d8-bad69dcaac9c', '7fedd3c1-82af-4b49-98ea-55b8dad33ff9'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:24:34.786825 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-ac7d676d-ae26-48a2-903d-b5bd90cff9b2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Network 0d49ad27-76fe-421c-86d6-138a53bc5d1c is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:24:34.791985 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-ac7d676d-ae26-48a2-903d-b5bd90cff9b2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:24:34.794390 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-ac7d676d-ae26-48a2-903d-b5bd90cff9b2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:24:34.828398 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac7d676d-ae26-48a2-903d-b5bd90cff9b2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Pushing event updated for resources: {'Port': ['ID=03261358-2e56-4bc9-a189-253e933a58f7,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:34.851377 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-ac7d676d-ae26-48a2-903d-b5bd90cff9b2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:34.851916 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-ac7d676d-ae26-48a2-903d-b5bd90cff9b2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:34.919672 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-ac7d676d-ae26-48a2-903d-b5bd90cff9b2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1615777 Nov 11 17:24:34.933028 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Request body: {'port': {'device_id': 'cf9304b8-18c1-4c82-92e0-8bf687c4802c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:24:34.990178 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:35.001319 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4351903e-317d-4177-b745-5d9d083083ac req-58dd504a-1f8f-4195-bcdd-5ca4f29c7e3d tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:35.002788 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4351903e-317d-4177-b745-5d9d083083ac req-58dd504a-1f8f-4195-bcdd-5ca4f29c7e3d tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0503697 Nov 11 17:24:35.059041 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4351903e-317d-4177-b745-5d9d083083ac req-61b12348-a27c-4dec-ac13-8e7078bda0b6 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0491359 Nov 11 17:24:35.256245 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 03261358-2e56-4bc9-a189-253e933a58f7 {{(pid=102324) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:24:35.263500 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:35.275083 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.provisioning_blocks [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Transition to ACTIVE for port object 03261358-2e56-4bc9-a189-253e933a58f7 will not be triggered until provisioned by entity L2. {{(pid=102324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:24:35.339025 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:35.386936 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Pushing event updated for resources: {'Port': ['ID=03261358-2e56-4bc9-a189-253e933a58f7,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:35.460138 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Attempting to bind port 03261358-2e56-4bc9-a189-253e933a58f7 on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:24:35.460641 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Attempting to bind port 03261358-2e56-4bc9-a189-253e933a58f7 by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:24:35.460872 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Attempting to bind port 03261358-2e56-4bc9-a189-253e933a58f7 on network 0d49ad27-76fe-421c-86d6-138a53bc5d1c {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:24:35.476090 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Port 03261358-2e56-4bc9-a189-253e933a58f7 on network 0d49ad27-76fe-421c-86d6-138a53bc5d1c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:24:35.476414 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Attempting to bind port 03261358-2e56-4bc9-a189-253e933a58f7 on network 0d49ad27-76fe-421c-86d6-138a53bc5d1c {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:24:35.495387 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 24, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:24:35.495721 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Checking segment: {'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:24:35.496103 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Bound using segment: {'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:24:35.496531 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Bound port: 03261358-2e56-4bc9-a189-253e933a58f7, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '173487ed-3830-4fbf-b2c1-18f1333338b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c'}}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:24:35.496888 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:35.544146 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eb4ac37-3710-4f34-a7f7-c8b0542adecd req-65965d39-081b-4b4c-ab08-f28086ca86b4 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:35.545560 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7eb4ac37-3710-4f34-a7f7-c8b0542adecd req-65965d39-081b-4b4c-ab08-f28086ca86b4 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 943 time: 0.0815942 Nov 11 17:24:35.599304 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] For port 03261358-2e56-4bc9-a189-253e933a58f7, host hv-cinder-69414, cleared binding levels {{(pid=102324) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:24:35.618486 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] For port 03261358-2e56-4bc9-a189-253e933a58f7, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=03261358-2e56-4bc9-a189-253e933a58f7,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102324) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:24:35.622753 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-7eb4ac37-3710-4f34-a7f7-c8b0542adecd req-7363811f-14f2-417d-aef2-ae8944948166 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0684850 Nov 11 17:24:35.665482 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:35.703092 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:35.703711 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:35.705113 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] 10.222.0.10 "PUT /v2.0/ports/03261358-2e56-4bc9-a189-253e933a58f7 HTTP/1.1" status: 200 len: 1093 time: 0.7765663 Nov 11 17:24:35.705799 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cf9304b8-18c1-4c82-92e0-8bf687c4802c', 'tag': '03261358-2e56-4bc9-a189-253e933a58f7'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:24:35.708695 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8c58e19c-eff1-447e-b641-c536d0dd5ab5" -d '{"events": [{"name": "network-changed", "server_uuid": "cf9304b8-18c1-4c82-92e0-8bf687c4802c", "tag": "03261358-2e56-4bc9-a189-253e933a58f7"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:24:35.731977 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf459fb0-e830-44c3-b0e4-289c0ef38d67 service neutron] Pushing event updated for resources: {'Port': ['ID=03261358-2e56-4bc9-a189-253e933a58f7,revision_number=3']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:35.747945 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:24:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-226f4eb8-22a0-436a-aa29-02f85a32007e x-openstack-request-id: req-226f4eb8-22a0-436a-aa29-02f85a32007e {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:24:35.749860 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cf9304b8-18c1-4c82-92e0-8bf687c4802c", "tag": "03261358-2e56-4bc9-a189-253e933a58f7", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:24:35.749860 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-226f4eb8-22a0-436a-aa29-02f85a32007e {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:24:35.749860 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cf9304b8-18c1-4c82-92e0-8bf687c4802c', 'tag': '03261358-2e56-4bc9-a189-253e933a58f7', 'status': 'completed', 'code': 200} Nov 11 17:24:35.814284 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c58e19c-eff1-447e-b641-c536d0dd5ab5 req-461a237c-1e66-4337-b79f-0e07588c4279 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:35.815510 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8c58e19c-eff1-447e-b641-c536d0dd5ab5 req-461a237c-1e66-4337-b79f-0e07588c4279 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=c02f323bd05c4d6bbbadfb2cf91bd62d&device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 1096 time: 0.0398552 Nov 11 17:24:35.911683 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c58e19c-eff1-447e-b641-c536d0dd5ab5 req-e6c24183-dcf5-48d7-a296-79a624d72528 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:35.913165 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8c58e19c-eff1-447e-b641-c536d0dd5ab5 req-e6c24183-dcf5-48d7-a296-79a624d72528 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=c02f323bd05c4d6bbbadfb2cf91bd62d&shared=False HTTP/1.1" status: 200 len: 916 time: 0.0896730 Nov 11 17:24:36.010927 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c58e19c-eff1-447e-b641-c536d0dd5ab5 req-7dfd5a85-adb0-4b5d-bc06-bc735abb3f7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:36.012428 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8c58e19c-eff1-447e-b641-c536d0dd5ab5 req-7dfd5a85-adb0-4b5d-bc06-bc735abb3f7c service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0913191 Nov 11 17:24:36.099893 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-5edff1fd-f8ce-418a-956a-ac31edfa3d05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:36.101491 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-5edff1fd-f8ce-418a-956a-ac31edfa3d05 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=c02f323bd05c4d6bbbadfb2cf91bd62d&device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 1096 time: 0.0434480 Nov 11 17:24:36.164143 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-06e92bf6-623b-4992-9211-737887ec606b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=03261358-2e56-4bc9-a189-253e933a58f7 HTTP/1.1" status: 200 len: 217 time: 0.0480685 Nov 11 17:24:36.232073 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-1394c258-67b5-40b1-b7aa-acbaf5d05fb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:36.233512 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-1394c258-67b5-40b1-b7aa-acbaf5d05fb6 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=92bc39c3-f62a-4a09-b809-9f253b9c7487 HTTP/1.1" status: 200 len: 855 time: 0.0520113 Nov 11 17:24:36.242318 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-891575d1-efc0-4277-b046-77d2269ba441 req-27457895-1822-44aa-8210-4da2d696ff63 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:36.243707 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-891575d1-efc0-4277-b046-77d2269ba441 req-27457895-1822-44aa-8210-4da2d696ff63 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0890641 Nov 11 17:24:36.278206 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-e84f4c6b-43ad-49fb-83f0-4c77596787e2 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=0d49ad27-76fe-421c-86d6-138a53bc5d1c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0296471 Nov 11 17:24:36.345334 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:36.368936 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-891575d1-efc0-4277-b046-77d2269ba441 req-822b7901-435e-436b-8461-b9731ac79dec tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1192901 Nov 11 17:24:36.398312 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-453aeff2-94ce-4903-a8fb-a1ace1fa0f95 service neutron] 10.222.0.10 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1120682 Nov 11 17:24:36.493392 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c3d00cb1-180c-4da1-b6af-2eca1b134002 req-6fe6ee94-ffe2-491c-9152-76a0e48670e3 service neutron] 10.222.0.10 "GET /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871725 Nov 11 17:24:36.745364 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a124a9dc-8c74-4026-bd64-ca11b08a13c6 req-3e6ff324-f70d-4fb9-829f-7a2efa875aef tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:36.746864 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a124a9dc-8c74-4026-bd64-ca11b08a13c6 req-3e6ff324-f70d-4fb9-829f-7a2efa875aef tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 943 time: 0.0491085 Nov 11 17:24:36.798168 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a124a9dc-8c74-4026-bd64-ca11b08a13c6 req-fc9e187d-643c-4d7c-b229-10d373940e59 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452299 Nov 11 17:24:36.996989 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:37.487249 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74973815-4441-455b-90e5-9137aca34ddd req-0efa0bdd-a16c-41c2-b99a-a6d61a8916e5 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:37.489218 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-74973815-4441-455b-90e5-9137aca34ddd req-0efa0bdd-a16c-41c2-b99a-a6d61a8916e5 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0532961 Nov 11 17:24:37.539646 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-74973815-4441-455b-90e5-9137aca34ddd req-a93c0d26-2b85-4a6a-ab1a-a90a195f99d6 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444465 Nov 11 17:24:38.057936 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-598eedf1-de2b-42ec-a2b0-74506e4ed650 req-a4a89d32-dc02-4795-99c4-3bc9e2e4e220 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:38.059450 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-598eedf1-de2b-42ec-a2b0-74506e4ed650 req-a4a89d32-dc02-4795-99c4-3bc9e2e4e220 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 943 time: 0.0491934 Nov 11 17:24:38.106527 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-598eedf1-de2b-42ec-a2b0-74506e4ed650 req-a8b6d753-a3c7-4d46-a090-5bc7aa19329a tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411079 Nov 11 17:24:38.663848 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfc83598-4731-4046-8113-d5917a113969 req-1a8443ae-d57d-4be8-b3eb-5333b9514aa2 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:38.665336 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dfc83598-4731-4046-8113-d5917a113969 req-1a8443ae-d57d-4be8-b3eb-5333b9514aa2 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0585589 Nov 11 17:24:38.712259 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:24:38.722795 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dfc83598-4731-4046-8113-d5917a113969 req-22dda98e-a142-4552-ae7d-dd52c96c36e2 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0514848 Nov 11 17:24:38.824803 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,segment=NetworkSegment(84e8dda5-3747-4e23-984b-1e3957701cfb),segment_id=84e8dda5-3747-4e23-984b-1e3957701cfb)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:38.837811 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78', 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'port_id': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78', 'mac_address': 'fa:16:3e:21:43:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 548, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:24:38.885625 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:38.899296 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:24:38.918770 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,segment=NetworkSegment(84e8dda5-3747-4e23-984b-1e3957701cfb),segment_id=84e8dda5-3747-4e23-984b-1e3957701cfb)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:39.024991 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:39.074273 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:39.232073 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb10574-f885-4ed0-9452-b620a5cd6400 req-4e8f424d-5334-4d8d-bfbf-eb9b47a69ade tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:39.233889 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fdb10574-f885-4ed0-9452-b620a5cd6400 req-4e8f424d-5334-4d8d-bfbf-eb9b47a69ade tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 943 time: 0.0585117 Nov 11 17:24:39.283568 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['b4e35d20-ba9e-4d75-94f0-d6e6b8972c78'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:24:39.287363 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fdb10574-f885-4ed0-9452-b620a5cd6400 req-74737d9e-f091-41f0-91bf-45f8b812c7cf tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455928 Nov 11 17:24:39.839294 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dcab141-86cc-4d15-bc40-95bf15d1ad06 req-1aa1c4db-2d9a-4cc3-b428-fc87868cecfa tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:39.840773 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4dcab141-86cc-4d15-bc40-95bf15d1ad06 req-1aa1c4db-2d9a-4cc3-b428-fc87868cecfa tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 945 time: 0.0500920 Nov 11 17:24:39.891297 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4dcab141-86cc-4d15-bc40-95bf15d1ad06 req-e84e4169-ec53-4a21-ace6-c3577e5c6c00 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445499 Nov 11 17:24:40.409007 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37a51bc4-0847-4fea-aa90-90445756e356 req-18cb18ec-1ce8-42e0-b26f-99e8cf440bc2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:40.412862 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-37a51bc4-0847-4fea-aa90-90445756e356 req-18cb18ec-1ce8-42e0-b26f-99e8cf440bc2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 943 time: 0.0558736 Nov 11 17:24:40.458521 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-37a51bc4-0847-4fea-aa90-90445756e356 req-270e037b-48af-4f4a-8860-d81e6b056eff tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419931 Nov 11 17:24:40.707242 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 03261358-2e56-4bc9-a189-253e933a58f7 details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:24:40.711055 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:24:40.963573 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 03261358-2e56-4bc9-a189-253e933a58f7, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=03261358-2e56-4bc9-a189-253e933a58f7,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:40.975618 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': '03261358-2e56-4bc9-a189-253e933a58f7', 'network_id': '0d49ad27-76fe-421c-86d6-138a53bc5d1c', 'port_id': '03261358-2e56-4bc9-a189-253e933a58f7', 'mac_address': 'fa:16:3e:f8:ac:5d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 515, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '92bc39c3-f62a-4a09-b809-9f253b9c7487', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:24:41.002709 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:24:41.008302 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a99e4a2b-5e5c-4447-a72b-2acc62acfc44 req-30b55092-8d6f-470c-b07e-71d3b147d7b4 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:41.009802 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a99e4a2b-5e5c-4447-a72b-2acc62acfc44 req-30b55092-8d6f-470c-b07e-71d3b147d7b4 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 945 time: 0.0496283 Nov 11 17:24:41.011078 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:24:41.011431 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:41.040358 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:41.060834 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a99e4a2b-5e5c-4447-a72b-2acc62acfc44 req-b35c2f0c-06c4-4bce-813f-3e705cb090df tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448563 Nov 11 17:24:41.061482 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 03261358-2e56-4bc9-a189-253e933a58f7 {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:24:41.086215 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 03261358-2e56-4bc9-a189-253e933a58f7, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=03261358-2e56-4bc9-a189-253e933a58f7,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:41.124977 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:41.148765 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8a8298b6-d69a-409b-b494-a28f3a458069', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:24:41.151088 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-686ec7dc-19cd-4197-9e08-a1f3d5427e40" -d '{"events": [{"server_uuid": "8a8298b6-d69a-409b-b494-a28f3a458069", "name": "network-vif-plugged", "status": "completed", "tag": "b4e35d20-ba9e-4d75-94f0-d6e6b8972c78"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:24:41.162083 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:41.167842 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,segment=NetworkSegment(84e8dda5-3747-4e23-984b-1e3957701cfb),segment_id=84e8dda5-3747-4e23-984b-1e3957701cfb)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:41.188566 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:24:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5412132f-60bc-4511-a7a1-3bd784e17321 x-openstack-request-id: req-5412132f-60bc-4511-a7a1-3bd784e17321 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:24:41.188864 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8a8298b6-d69a-409b-b494-a28f3a458069", "name": "network-vif-plugged", "status": "completed", "tag": "b4e35d20-ba9e-4d75-94f0-d6e6b8972c78", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:24:41.189114 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-5412132f-60bc-4511-a7a1-3bd784e17321 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:24:41.189502 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8a8298b6-d69a-409b-b494-a28f3a458069', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78', 'code': 200} Nov 11 17:24:41.215377 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=03261358-2e56-4bc9-a189-253e933a58f7,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:41.241871 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:41.293169 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:41.457502 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['03261358-2e56-4bc9-a189-253e933a58f7'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:24:41.488335 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b8896db-9b07-460b-8573-d2160702d25c req-8f8d8148-53bf-4698-805c-ff13d392f884 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:41.489995 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4b8896db-9b07-460b-8573-d2160702d25c req-8f8d8148-53bf-4698-805c-ff13d392f884 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 1099 time: 0.0916052 Nov 11 17:24:41.567489 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4b8896db-9b07-460b-8573-d2160702d25c req-96d9e303-e179-4cc6-877d-f41e90fa2f41 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0695734 Nov 11 17:24:41.587424 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a55875d3-9211-49ab-a00e-4f9671f0f7df req-80b392d5-3e45-4fc0-b9ec-0096f5c47aab tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:41.588912 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a55875d3-9211-49ab-a00e-4f9671f0f7df req-80b392d5-3e45-4fc0-b9ec-0096f5c47aab tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 944 time: 0.0577817 Nov 11 17:24:41.635892 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a55875d3-9211-49ab-a00e-4f9671f0f7df req-8cf914b1-5135-4a68-95cc-cabd760eeebe tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406582 Nov 11 17:24:42.176749 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f44c117c-56bd-4f9c-9934-05bb3d578ade req-3c5b0e1e-6f2c-4ebb-b3fc-735927f6037f tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:42.178444 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f44c117c-56bd-4f9c-9934-05bb3d578ade req-3c5b0e1e-6f2c-4ebb-b3fc-735927f6037f tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.0503738 Nov 11 17:24:42.230011 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f44c117c-56bd-4f9c-9934-05bb3d578ade req-a3955fde-dab6-44ee-bf51-a3240815799d tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455978 Nov 11 17:24:42.709628 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 03261358-2e56-4bc9-a189-253e933a58f7 up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:24:42.757099 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-573a1a9d-7ce1-4281-9672-b90f7cac08e7 req-881d8f64-d939-47e3-a1b7-efa48385c302 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:42.759605 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-573a1a9d-7ce1-4281-9672-b90f7cac08e7 req-881d8f64-d939-47e3-a1b7-efa48385c302 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 944 time: 0.0547473 Nov 11 17:24:42.818380 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-573a1a9d-7ce1-4281-9672-b90f7cac08e7 req-c417ea1a-9497-4ae5-9cde-c0406de486dc tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467741 Nov 11 17:24:42.846822 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port 03261358-2e56-4bc9-a189-253e933a58f7 completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:24:42.851624 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port 03261358-2e56-4bc9-a189-253e933a58f7 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:24:42.856349 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:42.929329 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:42.961818 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port 03261358-2e56-4bc9-a189-253e933a58f7, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=03261358-2e56-4bc9-a189-253e933a58f7,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:24:43.053021 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:43.104023 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=03261358-2e56-4bc9-a189-253e933a58f7,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:43.190765 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf9304b8-18c1-4c82-92e0-8bf687c4802c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '03261358-2e56-4bc9-a189-253e933a58f7'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:24:43.193633 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-783afa9f-279c-4d21-abe8-cac768598435" -d '{"events": [{"server_uuid": "cf9304b8-18c1-4c82-92e0-8bf687c4802c", "name": "network-vif-plugged", "status": "completed", "tag": "03261358-2e56-4bc9-a189-253e933a58f7"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:24:43.229485 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:24:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9f2cbbe5-3ff4-401c-ac35-0be272dd63fd x-openstack-request-id: req-9f2cbbe5-3ff4-401c-ac35-0be272dd63fd {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:24:43.229783 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cf9304b8-18c1-4c82-92e0-8bf687c4802c", "name": "network-vif-plugged", "status": "completed", "tag": "03261358-2e56-4bc9-a189-253e933a58f7", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:24:43.230056 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-9f2cbbe5-3ff4-401c-ac35-0be272dd63fd {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:24:43.230446 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf9304b8-18c1-4c82-92e0-8bf687c4802c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '03261358-2e56-4bc9-a189-253e933a58f7', 'code': 200} Nov 11 17:24:43.494978 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da157942-80e7-4611-a904-7003ab158122 req-4fb3725e-9dd9-4698-9fcc-2c3cbc3cbdad tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:43.496372 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-da157942-80e7-4611-a904-7003ab158122 req-4fb3725e-9dd9-4698-9fcc-2c3cbc3cbdad tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.0504010 Nov 11 17:24:43.565568 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2675b73c-c7e2-400b-8cfc-269e28c33b59 req-93047e9c-7ce4-4aa1-b2a9-2c05e9799c42 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:43.568187 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2675b73c-c7e2-400b-8cfc-269e28c33b59 req-93047e9c-7ce4-4aa1-b2a9-2c05e9799c42 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 1098 time: 0.0707870 Nov 11 17:24:43.572806 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-da157942-80e7-4611-a904-7003ab158122 req-eff32ee0-f8c0-4918-9226-e42e6c01a975 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0676715 Nov 11 17:24:43.614209 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2675b73c-c7e2-400b-8cfc-269e28c33b59 req-09b18fc0-0ff9-45a2-a901-2ede9d12671f service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384438 Nov 11 17:24:43.684825 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5932b326-9e16-4be9-8417-98ea53ddee73 req-d014468f-123e-4955-8d9b-44c0f5be4f6a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:43.686261 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5932b326-9e16-4be9-8417-98ea53ddee73 req-d014468f-123e-4955-8d9b-44c0f5be4f6a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.0468423 Nov 11 17:24:43.737810 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5932b326-9e16-4be9-8417-98ea53ddee73 req-7001dfd6-5656-4976-8243-ebe98a26590f tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451474 Nov 11 17:24:43.759760 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 37302) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:43.926867 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb635154-0b84-494f-9434-ddf727424ba0 tempest-TestShelveInstance-348868398 tempest-TestShelveInstance-348868398-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:43.928374 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-eb635154-0b84-494f-9434-ddf727424ba0 tempest-TestShelveInstance-348868398 tempest-TestShelveInstance-348868398-project-admin] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 1094 time: 0.1676533 Nov 11 17:24:43.931464 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 37308) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:24:43.935979 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Request body: {'floatingip': {'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'port_id': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'fixed_ip_address': '172.20.0.14'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:24:43.945274 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e598c751-4d56-4ff2-a0cd-b5eb0a20bc5d req-d64bcd04-eeff-4a50-8801-d014c312e9cf tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:43.946779 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e598c751-4d56-4ff2-a0cd-b5eb0a20bc5d req-d64bcd04-eeff-4a50-8801-d014c312e9cf tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 945 time: 0.0591605 Nov 11 17:24:43.994814 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e598c751-4d56-4ff2-a0cd-b5eb0a20bc5d req-426b4afd-6db3-4593-8b97-dd963cc324b6 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415351 Nov 11 17:24:44.018746 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for floatingip, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:44.115369 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:44.220310 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_common [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Allocated IP 172.27.1.80 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/ea18439d-ded5-4767-aad7-7ff789497d69) {{(pid=102323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:24:44.319610 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for port, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:44.402002 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:44.446078 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:24:44.450514 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.base_scheduler [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Resources bound (agent type, host, resource id): {{(pid=102323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:24:44.455738 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Received port after_create {{(pid=102323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:24:44.458296 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Pushing event updated for resources: {'Port': ['ID=ea18439d-ded5-4767-aad7-7ff789497d69,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:45.111586 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:45.146428 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c376293-ae1a-4ec3-9237-66acf98b3547 req-4075a70a-b999-4670-96a7-a3b69238f087 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:45.147927 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4c376293-ae1a-4ec3-9237-66acf98b3547 req-4075a70a-b999-4670-96a7-a3b69238f087 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 945 time: 0.0849891 Nov 11 17:24:45.202284 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4c376293-ae1a-4ec3-9237-66acf98b3547 req-5741dd91-d95d-4383-9f09-8911d174b92b tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480499 Nov 11 17:24:45.281469 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:45.429127 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:45.536630 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:45.610259 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Pushing event updated for resources: {'Port': ['ID=ea18439d-ded5-4767-aad7-7ff789497d69,revision_number=2']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:24:45.620722 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:45.623123 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:24:45.630327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:24:45.630327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:24:45.630327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:24:45.630327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:24:45.630327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:24:45.630327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:24:45.630327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:24:45.630327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:24:45.630327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:24:45.630327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:24:45.630327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:24:45.729835 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.l3_db [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Floating IP 0968eb4b-d847-4921-93c1-df53213dead5 associated. External IP: 172.27.1.80, port: b4e35d20-ba9e-4d75-94f0-d6e6b8972c78. Nov 11 17:24:45.959944 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Router fbdb60a9-d48f-44d5-a652-95278f391d51 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:24:46.074017 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:24:46.085492 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12273b3a-2582-4d11-9751-848296664728 None None] Sync routers for ids ['fbdb60a9-d48f-44d5-a652-95278f391d51'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:24:46.096480 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12273b3a-2582-4d11-9751-848296664728 None None] Routers {'fbdb60a9-d48f-44d5-a652-95278f391d51'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:24:46.097139 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-12273b3a-2582-4d11-9751-848296664728 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:24:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['fbdb60a9-d48f-44d5-a652-95278f391d51'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:46.146592 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:46.177543 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-871cbc06-f079-4f9e-b3f5-35cedff8cb79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.2442658 Nov 11 17:24:46.177543 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8a8298b6-d69a-409b-b494-a28f3a458069', 'tag': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:24:46.179974 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-203e62b2-d082-4c48-bf94-8335d85bfcdf" -d '{"events": [{"name": "network-changed", "server_uuid": "8a8298b6-d69a-409b-b494-a28f3a458069", "tag": "b4e35d20-ba9e-4d75-94f0-d6e6b8972c78"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:24:46.215417 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-12273b3a-2582-4d11-9751-848296664728 None None] Set router fbdb60a9-d48f-44d5-a652-95278f391d51 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:24:46.221211 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:24:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c4d795b5-68c9-492d-b8a4-7098d470fa66 x-openstack-request-id: req-c4d795b5-68c9-492d-b8a4-7098d470fa66 {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:24:46.221502 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8a8298b6-d69a-409b-b494-a28f3a458069", "tag": "b4e35d20-ba9e-4d75-94f0-d6e6b8972c78", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:24:46.221753 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-c4d795b5-68c9-492d-b8a4-7098d470fa66 {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:24:46.222189 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8a8298b6-d69a-409b-b494-a28f3a458069', 'tag': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78', 'status': 'completed', 'code': 200} Nov 11 17:24:46.283517 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-203e62b2-d082-4c48-bf94-8335d85bfcdf req-ec36fe61-e30e-4689-99b7-884fed98890a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:46.285245 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-203e62b2-d082-4c48-bf94-8335d85bfcdf req-ec36fe61-e30e-4689-99b7-884fed98890a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=53c4ca7574da4b2a868a39a52a98e620&device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 1099 time: 0.0419588 Nov 11 17:24:46.379490 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-203e62b2-d082-4c48-bf94-8335d85bfcdf req-6a1cf5ec-fdcf-4cd1-9963-75393a74f5f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:46.381298 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-203e62b2-d082-4c48-bf94-8335d85bfcdf req-6a1cf5ec-fdcf-4cd1-9963-75393a74f5f3 service neutron] 10.222.0.10 "GET /v2.0/networks?id=e1e04a10-fb62-4a0a-a705-82de35b80b1b HTTP/1.1" status: 200 len: 910 time: 0.0889640 Nov 11 17:24:46.447473 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-203e62b2-d082-4c48-bf94-8335d85bfcdf req-4ebd132b-199a-4270-aa34-c6174d906416 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 HTTP/1.1" status: 200 len: 999 time: 0.0587652 Nov 11 17:24:46.449650 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-12273b3a-2582-4d11-9751-848296664728 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'name': 'tempest-TestShelveInstance-1336680617-router', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13'}], 'enable_snat': True}, 'gw_port_id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:47Z', 'updated_at': '2021-11-11T17:23:52Z', 'revision_number': 4, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'gw_port': {'id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:48:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:48Z', 'updated_at': '2021-11-11T17:23:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '0968eb4b-d847-4921-93c1-df53213dead5', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'floating_ip_address': '172.27.1.80', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'port_id': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 636, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'mac_address': 'fa:16:3e:21:43:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8a8298b6-d69a-409b-b494-a28f3a458069', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:24:44Z', 'updated_at': '2021-11-11T17:24:44Z', 'revision_number': 0, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '27767633-1ab7-44d5-890c-4a3c38c807f6', 'name': '', 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'mac_address': 'fa:16:3e:6a:e7:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:51Z', 'updated_at': '2021-11-11T17:23:55Z', 'revision_number': 5, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'subnets': [{'id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:46.481654 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12273b3a-2582-4d11-9751-848296664728 None None] Checking router: fbdb60a9-d48f-44d5-a652-95278f391d51 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:24:46.491502 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12273b3a-2582-4d11-9751-848296664728 None None] Routers {'fbdb60a9-d48f-44d5-a652-95278f391d51'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:24:46.492120 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-12273b3a-2582-4d11-9751-848296664728 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:24:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['fbdb60a9-d48f-44d5-a652-95278f391d51'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:46.511048 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-203e62b2-d082-4c48-bf94-8335d85bfcdf req-46adda5e-c301-422b-8185-8f883597dbd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:46.513011 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-203e62b2-d082-4c48-bf94-8335d85bfcdf req-46adda5e-c301-422b-8185-8f883597dbd6 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=45e5a299-340d-4f14-b0eb-66727a394b7c HTTP/1.1" status: 200 len: 848 time: 0.0583889 Nov 11 17:24:46.560351 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-203e62b2-d082-4c48-bf94-8335d85bfcdf req-cc4cf2a6-afe0-4479-b44e-5d19492cd7e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:46.561840 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-203e62b2-d082-4c48-bf94-8335d85bfcdf req-cc4cf2a6-afe0-4479-b44e-5d19492cd7e7 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=e1e04a10-fb62-4a0a-a705-82de35b80b1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0416982 Nov 11 17:24:46.605597 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-12273b3a-2582-4d11-9751-848296664728 None None] Set router fbdb60a9-d48f-44d5-a652-95278f391d51 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:24:46.653072 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-203e62b2-d082-4c48-bf94-8335d85bfcdf req-c4013b21-2b3e-48d3-9aee-5e277f916d7d service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837848 Nov 11 17:24:46.748356 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-203e62b2-d082-4c48-bf94-8335d85bfcdf req-4ca63c6b-5f89-4228-9acc-0acbbfca00ac service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0884259 Nov 11 17:24:46.841392 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-12273b3a-2582-4d11-9751-848296664728 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'name': 'tempest-TestShelveInstance-1336680617-router', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13'}], 'enable_snat': True}, 'gw_port_id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:47Z', 'updated_at': '2021-11-11T17:23:52Z', 'revision_number': 4, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'gw_port': {'id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:48:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:48Z', 'updated_at': '2021-11-11T17:23:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '0968eb4b-d847-4921-93c1-df53213dead5', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'floating_ip_address': '172.27.1.80', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'port_id': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 636, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'mac_address': 'fa:16:3e:21:43:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8a8298b6-d69a-409b-b494-a28f3a458069', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:24:44Z', 'updated_at': '2021-11-11T17:24:44Z', 'revision_number': 0, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '27767633-1ab7-44d5-890c-4a3c38c807f6', 'name': '', 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'mac_address': 'fa:16:3e:6a:e7:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:51Z', 'updated_at': '2021-11-11T17:23:55Z', 'revision_number': 5, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'subnets': [{'id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:24:46.873085 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12273b3a-2582-4d11-9751-848296664728 None None] The sync data for ids ['fbdb60a9-d48f-44d5-a652-95278f391d51'] in dv-cinder-694140-2-iscsi is: [{'id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'name': 'tempest-TestShelveInstance-1336680617-router', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13'}], 'enable_snat': True}, 'gw_port_id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:47Z', 'updated_at': '2021-11-11T17:23:52Z', 'revision_number': 4, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'gw_port': {'id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:48:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:48Z', 'updated_at': '2021-11-11T17:23:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': '0968eb4b-d847-4921-93c1-df53213dead5', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'floating_ip_address': '172.27.1.80', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'port_id': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 636, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'mac_address': 'fa:16:3e:21:43:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8a8298b6-d69a-409b-b494-a28f3a458069', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:24:44Z', 'updated_at': '2021-11-11T17:24:44Z', 'revision_number': 0, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '27767633-1ab7-44d5-890c-4a3c38c807f6', 'name': '', 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'mac_address': 'fa:16:3e:6a:e7:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:51Z', 'updated_at': '2021-11-11T17:23:55Z', 'revision_number': 5, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'subnets': [{'id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:24:46.967340 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:24:47.067449 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-785527c9-c70d-481e-b84b-0752e6a0aa74 None None] New status for floating IP 0968eb4b-d847-4921-93c1-df53213dead5: ACTIVE {{(pid=102326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:24:59.531821 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-384f1d89-6122-4a35-bd81-cb82fbbbaf9a req-ceaf8aa7-75f7-4601-bf74-b4ce91eec17a tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:24:59.533277 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-384f1d89-6122-4a35-bd81-cb82fbbbaf9a req-ceaf8aa7-75f7-4601-bf74-b4ce91eec17a tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 945 time: 0.0488718 Nov 11 17:24:59.583670 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-384f1d89-6122-4a35-bd81-cb82fbbbaf9a req-dbf3ada2-2368-4ebe-a619-7616b4e1fe70 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436156 Nov 11 17:25:00.709359 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d3a596-be4b-48c5-a6b7-aea04cb161b2 req-b7c781df-1efc-4b14-bf6d-1dbe27112935 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:25:00.710892 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-20d3a596-be4b-48c5-a6b7-aea04cb161b2 req-b7c781df-1efc-4b14-bf6d-1dbe27112935 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 945 time: 0.0505471 Nov 11 17:25:00.760938 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-20d3a596-be4b-48c5-a6b7-aea04cb161b2 req-ba13a04a-07b9-4615-a05a-dce4d1090839 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424030 Nov 11 17:25:00.943643 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-d44e8b02-6513-45c6-a702-d19edd64534d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:01.177982 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ef9fd5b-71c2-4383-bc94-5f8182c23c03 req-97b45890-556b-4008-98a7-bc8e7f280193 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:25:01.179505 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1ef9fd5b-71c2-4383-bc94-5f8182c23c03 req-97b45890-556b-4008-98a7-bc8e7f280193 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.10 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 945 time: 0.0519388 Nov 11 17:25:01.272812 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-1ef9fd5b-71c2-4383-bc94-5f8182c23c03 req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Deleting port 03261358-2e56-4bc9-a189-253e933a58f7 {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:25:01.273050 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-1ef9fd5b-71c2-4383-bc94-5f8182c23c03 req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:01.366380 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-1ef9fd5b-71c2-4383-bc94-5f8182c23c03 req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] For port 03261358-2e56-4bc9-a189-253e933a58f7, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=03261358-2e56-4bc9-a189-253e933a58f7,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:25:01.366767 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-1ef9fd5b-71c2-4383-bc94-5f8182c23c03 req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:01.381057 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-1ef9fd5b-71c2-4383-bc94-5f8182c23c03 req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Calling delete_port for 03261358-2e56-4bc9-a189-253e933a58f7 owned by compute:nova {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:25:01.572410 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-1ef9fd5b-71c2-4383-bc94-5f8182c23c03 req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:01.588252 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['70e42819-0a8f-45db-bd4b-b7af772f04ec', '6176c69f-e97f-44c0-93d8-bad69dcaac9c', '7fedd3c1-82af-4b49-98ea-55b8dad33ff9', '03261358-2e56-4bc9-a189-253e933a58f7'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:25:01.601674 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Pushing event deleted for resources: {'Port': ['ID=03261358-2e56-4bc9-a189-253e933a58f7,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:25:01.616255 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:25:01.616255 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:25:01.616255 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:25:01.616255 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:25:01.616653 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:25:01.616977 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:25:01.617314 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:25:01.617634 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:25:01.617954 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:25:01.618274 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:25:01.618608 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:25:01.618935 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:25:01.654039 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-1ef9fd5b-71c2-4383-bc94-5f8182c23c03 req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] No DVR routers for this DVR port 03261358-2e56-4bc9-a189-253e933a58f7 on host hv-cinder-69414 {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:25:01.656737 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-1ef9fd5b-71c2-4383-bc94-5f8182c23c03 req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:01.660050 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-1ef9fd5b-71c2-4383-bc94-5f8182c23c03 req-e56e682a-57fe-4e94-914b-22f090864f84 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.10 "DELETE /v2.0/ports/03261358-2e56-4bc9-a189-253e933a58f7 HTTP/1.1" status: 204 len: 173 time: 0.4745123 Nov 11 17:25:01.660503 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf9304b8-18c1-4c82-92e0-8bf687c4802c', 'name': 'network-vif-deleted', 'tag': '03261358-2e56-4bc9-a189-253e933a58f7'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:25:01.663121 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8df6be96-e231-43c3-ac57-eaad2e8b0b29" -d '{"events": [{"server_uuid": "cf9304b8-18c1-4c82-92e0-8bf687c4802c", "name": "network-vif-deleted", "tag": "03261358-2e56-4bc9-a189-253e933a58f7"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:25:01.774330 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:25:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0de7a97c-8e18-4ef4-a25e-d4b067e45427 x-openstack-request-id: req-0de7a97c-8e18-4ef4-a25e-d4b067e45427 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:25:01.774999 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cf9304b8-18c1-4c82-92e0-8bf687c4802c", "name": "network-vif-deleted", "tag": "03261358-2e56-4bc9-a189-253e933a58f7", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:25:01.774999 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-0de7a97c-8e18-4ef4-a25e-d4b067e45427 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:25:01.775285 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf9304b8-18c1-4c82-92e0-8bf687c4802c', 'name': 'network-vif-deleted', 'tag': '03261358-2e56-4bc9-a189-253e933a58f7', 'status': 'completed', 'code': 200} Nov 11 17:25:01.888622 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f9892865-f3cf-41cf-9b9d-0aaede813e26 req-d5dd1536-4d30-4a42-a071-2dd98617a8cf tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf9304b8-18c1-4c82-92e0-8bf687c4802c HTTP/1.1" status: 200 len: 210 time: 0.0423884 Nov 11 17:25:03.657467 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c569e519-decc-4722-8a4a-569824fdc796 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:04.703735 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:04.826171 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f9d9592-7df0-4926-b4da-2e795e11d2b9 req-cd55542e-b49e-46aa-9ab8-09c076da876b tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:25:04.828120 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1f9d9592-7df0-4926-b4da-2e795e11d2b9 req-cd55542e-b49e-46aa-9ab8-09c076da876b tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 945 time: 0.0544300 Nov 11 17:25:04.885997 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-1f9d9592-7df0-4926-b4da-2e795e11d2b9 req-ee4241f6-570c-45a0-a3e0-dfafbd2c730f tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508668 Nov 11 17:25:06.018226 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22047b9a-b067-44a9-b1d5-be224db228e0 req-db5c9633-054a-4d4c-91de-e52a29e2bc82 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:25:06.019882 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-22047b9a-b067-44a9-b1d5-be224db228e0 req-db5c9633-054a-4d4c-91de-e52a29e2bc82 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 945 time: 0.0591083 Nov 11 17:25:06.075767 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-22047b9a-b067-44a9-b1d5-be224db228e0 req-1b6bbd96-dcdb-41cf-a1ea-95744eaaa812 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482450 Nov 11 17:25:06.383429 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:06.475734 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32c9fc8a-6942-4dfb-bd0c-9e8a93e7cc83 req-d256f187-a7a8-40ae-8bb5-c3425a0a8b0c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:25:06.477279 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-32c9fc8a-6942-4dfb-bd0c-9e8a93e7cc83 req-d256f187-a7a8-40ae-8bb5-c3425a0a8b0c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 945 time: 0.0530820 Nov 11 17:25:06.577642 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-32c9fc8a-6942-4dfb-bd0c-9e8a93e7cc83 req-338ef068-264a-45af-8e04-798dd2ac41d4 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Deleting port 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:25:06.578040 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-32c9fc8a-6942-4dfb-bd0c-9e8a93e7cc83 req-338ef068-264a-45af-8e04-798dd2ac41d4 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:06.682128 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-32c9fc8a-6942-4dfb-bd0c-9e8a93e7cc83 req-338ef068-264a-45af-8e04-798dd2ac41d4 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] For port 7fedd3c1-82af-4b49-98ea-55b8dad33ff9, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=7fedd3c1-82af-4b49-98ea-55b8dad33ff9,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:25:06.682563 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-32c9fc8a-6942-4dfb-bd0c-9e8a93e7cc83 req-338ef068-264a-45af-8e04-798dd2ac41d4 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:06.697803 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-32c9fc8a-6942-4dfb-bd0c-9e8a93e7cc83 req-338ef068-264a-45af-8e04-798dd2ac41d4 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Calling delete_port for 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 owned by compute:nova {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:25:06.801269 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 03261358-2e56-4bc9-a189-253e933a58f7 no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:25:06.837117 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: 03261358-2e56-4bc9-a189-253e933a58f7 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:25:06.837614 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 03261358-2e56-4bc9-a189-253e933a58f7 not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:25:06.915151 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-32c9fc8a-6942-4dfb-bd0c-9e8a93e7cc83 req-338ef068-264a-45af-8e04-798dd2ac41d4 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:06.932334 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['70e42819-0a8f-45db-bd4b-b7af772f04ec', '6176c69f-e97f-44c0-93d8-bad69dcaac9c', '7fedd3c1-82af-4b49-98ea-55b8dad33ff9'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:25:06.946595 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-338ef068-264a-45af-8e04-798dd2ac41d4 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Pushing event deleted for resources: {'Port': ['ID=7fedd3c1-82af-4b49-98ea-55b8dad33ff9,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:25:07.014322 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-32c9fc8a-6942-4dfb-bd0c-9e8a93e7cc83 req-338ef068-264a-45af-8e04-798dd2ac41d4 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] No DVR routers for this DVR port 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 on host hv-cinder-69414 {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:25:07.018773 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-32c9fc8a-6942-4dfb-bd0c-9e8a93e7cc83 req-338ef068-264a-45af-8e04-798dd2ac41d4 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:07.022458 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-32c9fc8a-6942-4dfb-bd0c-9e8a93e7cc83 req-338ef068-264a-45af-8e04-798dd2ac41d4 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.10 "DELETE /v2.0/ports/7fedd3c1-82af-4b49-98ea-55b8dad33ff9 HTTP/1.1" status: 204 len: 173 time: 0.5370076 Nov 11 17:25:07.022966 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ebd58e3-5acf-4516-bc24-5105ba5333e9', 'name': 'network-vif-deleted', 'tag': '7fedd3c1-82af-4b49-98ea-55b8dad33ff9'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:25:07.025258 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-78d3f9fc-585e-467b-bc30-903cf7de534a" -d '{"events": [{"server_uuid": "4ebd58e3-5acf-4516-bc24-5105ba5333e9", "name": "network-vif-deleted", "tag": "7fedd3c1-82af-4b49-98ea-55b8dad33ff9"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:25:07.058216 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:07.077518 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:25:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ace23eff-ef5d-4c8a-be78-4c8eceda9f85 x-openstack-request-id: req-ace23eff-ef5d-4c8a-be78-4c8eceda9f85 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:25:07.077959 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ebd58e3-5acf-4516-bc24-5105ba5333e9", "name": "network-vif-deleted", "tag": "7fedd3c1-82af-4b49-98ea-55b8dad33ff9", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:25:07.078313 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-ace23eff-ef5d-4c8a-be78-4c8eceda9f85 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:25:07.079232 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ebd58e3-5acf-4516-bc24-5105ba5333e9', 'name': 'network-vif-deleted', 'tag': '7fedd3c1-82af-4b49-98ea-55b8dad33ff9', 'status': 'completed', 'code': 200} Nov 11 17:25:07.190734 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2959df4a-157f-490f-bbd1-5b7a740bca36 req-8b1617e3-0386-4dac-aa5d-e04aa23f6c2c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=4ebd58e3-5acf-4516-bc24-5105ba5333e9 HTTP/1.1" status: 200 len: 210 time: 0.0385191 Nov 11 17:25:08.192692 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:25:08.773547 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2ff29ef-7de0-41b3-8576-33ec995fa7ca req-32c939c7-8e54-438b-8cb3-dd1c90bb440f tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:25:08.775410 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f2ff29ef-7de0-41b3-8576-33ec995fa7ca req-32c939c7-8e54-438b-8cb3-dd1c90bb440f tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 945 time: 0.0633273 Nov 11 17:25:08.831805 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f2ff29ef-7de0-41b3-8576-33ec995fa7ca req-bad62ae7-88e3-42ea-80fe-0556a2b4b473 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459678 Nov 11 17:25:09.984940 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93861c03-3f30-42a0-919a-9c117717fad1 req-9323ee1b-df56-48dc-9e13-61166499fb4c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:25:09.987123 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-93861c03-3f30-42a0-919a-9c117717fad1 req-9323ee1b-df56-48dc-9e13-61166499fb4c tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 945 time: 0.0794482 Nov 11 17:25:10.043424 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-93861c03-3f30-42a0-919a-9c117717fad1 req-d96832e7-6f2d-425e-a0ba-821f2ab2ee04 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494218 Nov 11 17:25:10.154426 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8478b1b-9cbd-44fc-b753-e271b20cf66c req-04ed4849-5ffc-4879-9a1d-4c67ebba5a11 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:25:10.155900 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e8478b1b-9cbd-44fc-b753-e271b20cf66c req-04ed4849-5ffc-4879-9a1d-4c67ebba5a11 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.10 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 945 time: 0.0584972 Nov 11 17:25:10.263768 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-e8478b1b-9cbd-44fc-b753-e271b20cf66c req-e862f62c-8952-458d-993c-52acea29830a tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Deleting port 6176c69f-e97f-44c0-93d8-bad69dcaac9c {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:25:10.264335 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-e8478b1b-9cbd-44fc-b753-e271b20cf66c req-e862f62c-8952-458d-993c-52acea29830a tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:10.369517 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-e8478b1b-9cbd-44fc-b753-e271b20cf66c req-e862f62c-8952-458d-993c-52acea29830a tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] For port 6176c69f-e97f-44c0-93d8-bad69dcaac9c, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=6176c69f-e97f-44c0-93d8-bad69dcaac9c,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:25:10.369874 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-e8478b1b-9cbd-44fc-b753-e271b20cf66c req-e862f62c-8952-458d-993c-52acea29830a tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:10.384552 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-e8478b1b-9cbd-44fc-b753-e271b20cf66c req-e862f62c-8952-458d-993c-52acea29830a tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Calling delete_port for 6176c69f-e97f-44c0-93d8-bad69dcaac9c owned by compute:nova {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:25:10.708844 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-e8478b1b-9cbd-44fc-b753-e271b20cf66c req-e862f62c-8952-458d-993c-52acea29830a tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:10.724556 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['70e42819-0a8f-45db-bd4b-b7af772f04ec', '6176c69f-e97f-44c0-93d8-bad69dcaac9c'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:25:10.745663 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e862f62c-8952-458d-993c-52acea29830a tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Pushing event deleted for resources: {'Port': ['ID=6176c69f-e97f-44c0-93d8-bad69dcaac9c,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:25:10.801151 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-e8478b1b-9cbd-44fc-b753-e271b20cf66c req-e862f62c-8952-458d-993c-52acea29830a tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] No DVR routers for this DVR port 6176c69f-e97f-44c0-93d8-bad69dcaac9c on host hv-cinder-69414 {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:25:10.804118 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-e8478b1b-9cbd-44fc-b753-e271b20cf66c req-e862f62c-8952-458d-993c-52acea29830a tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:10.809078 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-e8478b1b-9cbd-44fc-b753-e271b20cf66c req-e862f62c-8952-458d-993c-52acea29830a tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.10 "DELETE /v2.0/ports/6176c69f-e97f-44c0-93d8-bad69dcaac9c HTTP/1.1" status: 204 len: 173 time: 0.6449523 Nov 11 17:25:10.809828 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd4ee3379-5ccf-431e-8f53-6626b9a4b498', 'name': 'network-vif-deleted', 'tag': '6176c69f-e97f-44c0-93d8-bad69dcaac9c'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:25:10.813086 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cb3459d6-d9e7-4dc4-b976-5186c0594b18" -d '{"events": [{"server_uuid": "d4ee3379-5ccf-431e-8f53-6626b9a4b498", "name": "network-vif-deleted", "tag": "6176c69f-e97f-44c0-93d8-bad69dcaac9c"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:25:10.816358 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:25:10.841923 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:25:10.842301 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 7fedd3c1-82af-4b49-98ea-55b8dad33ff9 not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:25:10.880223 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:25:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c05466f5-b447-4965-a303-4bfa4d561232 x-openstack-request-id: req-c05466f5-b447-4965-a303-4bfa4d561232 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:25:10.880511 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d4ee3379-5ccf-431e-8f53-6626b9a4b498", "name": "network-vif-deleted", "tag": "6176c69f-e97f-44c0-93d8-bad69dcaac9c", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:25:10.880754 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-c05466f5-b447-4965-a303-4bfa4d561232 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:25:10.881146 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd4ee3379-5ccf-431e-8f53-6626b9a4b498', 'name': 'network-vif-deleted', 'tag': '6176c69f-e97f-44c0-93d8-bad69dcaac9c', 'status': 'completed', 'code': 200} Nov 11 17:25:11.148979 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4ffb09bd-e5d2-431c-92b8-153aa812b415 req-beb2f35b-659a-4c28-9e86-45d2aa750af5 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=d4ee3379-5ccf-431e-8f53-6626b9a4b498 HTTP/1.1" status: 200 len: 210 time: 0.0310786 Nov 11 17:25:14.040177 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29a3aac2-2446-4606-8395-3d6c17e9a60a req-aa77de69-db85-4260-b4c7-9eb1541e25c2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:25:14.041859 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-29a3aac2-2446-4606-8395-3d6c17e9a60a req-aa77de69-db85-4260-b4c7-9eb1541e25c2 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 946 time: 0.0642281 Nov 11 17:25:14.101603 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-29a3aac2-2446-4606-8395-3d6c17e9a60a req-90f616e8-f964-4a1f-a62c-2bfec94df8b8 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500438 Nov 11 17:25:14.861067 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 6176c69f-e97f-44c0-93d8-bad69dcaac9c no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:25:14.883556 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: 6176c69f-e97f-44c0-93d8-bad69dcaac9c {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:25:14.883901 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 6176c69f-e97f-44c0-93d8-bad69dcaac9c not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:25:15.246003 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c75d9b8-ef3c-4de2-a056-8039137d7342 req-194c36e5-ff6d-41ee-b2bf-5165e3ff0ce0 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:25:15.247649 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3c75d9b8-ef3c-4de2-a056-8039137d7342 req-194c36e5-ff6d-41ee-b2bf-5165e3ff0ce0 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 946 time: 0.0609374 Nov 11 17:25:15.301348 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3c75d9b8-ef3c-4de2-a056-8039137d7342 req-5bcc16e7-bcb2-411a-aaab-079469abdfa9 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/security-groups?id=528ee871-45ec-4320-80d8-ae5c846539a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467873 Nov 11 17:25:15.648836 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3896fa30-15c6-46e0-b68c-905381ff02e5 req-dcec7e6f-ecfc-46be-9c54-8319a4119b1f tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:25:15.650406 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3896fa30-15c6-46e0-b68c-905381ff02e5 req-dcec7e6f-ecfc-46be-9c54-8319a4119b1f tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.10 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 946 time: 0.0522292 Nov 11 17:25:15.753839 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-3896fa30-15c6-46e0-b68c-905381ff02e5 req-32e4b028-3549-4a53-8623-c38e09c89351 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Deleting port 70e42819-0a8f-45db-bd4b-b7af772f04ec {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:25:15.754180 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-3896fa30-15c6-46e0-b68c-905381ff02e5 req-32e4b028-3549-4a53-8623-c38e09c89351 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:15.854677 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-3896fa30-15c6-46e0-b68c-905381ff02e5 req-32e4b028-3549-4a53-8623-c38e09c89351 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] For port 70e42819-0a8f-45db-bd4b-b7af772f04ec, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=70e42819-0a8f-45db-bd4b-b7af772f04ec,segment=NetworkSegment(173487ed-3830-4fbf-b2c1-18f1333338b7),segment_id=173487ed-3830-4fbf-b2c1-18f1333338b7)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:25:15.855091 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-3896fa30-15c6-46e0-b68c-905381ff02e5 req-32e4b028-3549-4a53-8623-c38e09c89351 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:15.874572 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-3896fa30-15c6-46e0-b68c-905381ff02e5 req-32e4b028-3549-4a53-8623-c38e09c89351 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Calling delete_port for 70e42819-0a8f-45db-bd4b-b7af772f04ec owned by compute:nova {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:25:16.091747 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-3896fa30-15c6-46e0-b68c-905381ff02e5 req-32e4b028-3549-4a53-8623-c38e09c89351 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:16.104953 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['70e42819-0a8f-45db-bd4b-b7af772f04ec'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:25:16.137970 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32e4b028-3549-4a53-8623-c38e09c89351 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Pushing event deleted for resources: {'Port': ['ID=70e42819-0a8f-45db-bd4b-b7af772f04ec,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:25:16.188190 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-3896fa30-15c6-46e0-b68c-905381ff02e5 req-32e4b028-3549-4a53-8623-c38e09c89351 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] No DVR routers for this DVR port 70e42819-0a8f-45db-bd4b-b7af772f04ec on host hv-cinder-69414 {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:25:16.191431 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-3896fa30-15c6-46e0-b68c-905381ff02e5 req-32e4b028-3549-4a53-8623-c38e09c89351 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:16.195014 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3896fa30-15c6-46e0-b68c-905381ff02e5 req-32e4b028-3549-4a53-8623-c38e09c89351 tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.10 "DELETE /v2.0/ports/70e42819-0a8f-45db-bd4b-b7af772f04ec HTTP/1.1" status: 204 len: 173 time: 0.5383456 Nov 11 17:25:16.195497 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c1d80c3c-a50f-4ee9-8d8a-84bd9920d108', 'name': 'network-vif-deleted', 'tag': '70e42819-0a8f-45db-bd4b-b7af772f04ec'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:25:16.197856 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f6de094-1a24-4213-ab3e-382c9dccecd7" -d '{"events": [{"server_uuid": "c1d80c3c-a50f-4ee9-8d8a-84bd9920d108", "name": "network-vif-deleted", "tag": "70e42819-0a8f-45db-bd4b-b7af772f04ec"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:25:16.261221 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:25:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2c212e8e-59cc-4992-86f8-f4a9937b155f x-openstack-request-id: req-2c212e8e-59cc-4992-86f8-f4a9937b155f {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:25:16.262297 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c1d80c3c-a50f-4ee9-8d8a-84bd9920d108", "name": "network-vif-deleted", "tag": "70e42819-0a8f-45db-bd4b-b7af772f04ec", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:25:16.262297 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-2c212e8e-59cc-4992-86f8-f4a9937b155f {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:25:16.262814 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c1d80c3c-a50f-4ee9-8d8a-84bd9920d108', 'name': 'network-vif-deleted', 'tag': '70e42819-0a8f-45db-bd4b-b7af772f04ec', 'status': 'completed', 'code': 200} Nov 11 17:25:16.421044 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3f197eac-a062-4cbc-84ff-22621f8b0fb8 req-035f8d1e-382e-4650-95ab-143298fffe4e tempest-AttachVolumeNegativeTest-276884731 tempest-AttachVolumeNegativeTest-276884731-project] 10.222.0.16 "GET /v2.0/ports?device_id=c1d80c3c-a50f-4ee9-8d8a-84bd9920d108 HTTP/1.1" status: 200 len: 210 time: 0.0301547 Nov 11 17:25:16.948345 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:17.485747 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 37444) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:25:17.537918 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_v2 [None req-d12e91d1-7c65-4d22-a7b6-46d6bfd0c431 admin admin] Deleting subnet 92bc39c3-f62a-4a09-b809-9f253b9c7487 {{(pid=102323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:25:17.541869 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d12e91d1-7c65-4d22-a7b6-46d6bfd0c431 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:17.583670 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d12e91d1-7c65-4d22-a7b6-46d6bfd0c431 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5777079'] for subnet, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:17.629338 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d12e91d1-7c65-4d22-a7b6-46d6bfd0c431 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:17.800488 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d12e91d1-7c65-4d22-a7b6-46d6bfd0c431 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5720643', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5388326'] for subnet, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:17.831080 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d12e91d1-7c65-4d22-a7b6-46d6bfd0c431 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=92bc39c3-f62a-4a09-b809-9f253b9c7487,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:25:17.835763 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-d12e91d1-7c65-4d22-a7b6-46d6bfd0c431 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:17.839324 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-d12e91d1-7c65-4d22-a7b6-46d6bfd0c431 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/92bc39c3-f62a-4a09-b809-9f253b9c7487 HTTP/1.1" status: 204 len: 168 time: 0.3524022 Nov 11 17:25:17.843034 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 37446) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:25:17.859066 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4ffcbe60-ab4f-4bb3-a099-e19c67960e94 req-9828f428-ed6c-4370-9a4f-46f385258f18 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0548687 Nov 11 17:25:17.923969 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ad290348-d22c-477c-9094-a9fb065d1273 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:17.968040 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffcbe60-ab4f-4bb3-a099-e19c67960e94 req-99909a5c-84e0-498b-b951-3cc4497a18f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:25:17.969567 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4ffcbe60-ab4f-4bb3-a099-e19c67960e94 req-99909a5c-84e0-498b-b951-3cc4497a18f5 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=53c4ca7574da4b2a868a39a52a98e620&device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 1099 time: 0.0513599 Nov 11 17:25:18.054332 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ad290348-d22c-477c-9094-a9fb065d1273 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:18.096560 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-ad290348-d22c-477c-9094-a9fb065d1273 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0d49ad27-76fe-421c-86d6-138a53bc5d1c']}} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:25:18.109288 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-ad290348-d22c-477c-9094-a9fb065d1273 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '173487ed-3830-4fbf-b2c1-18f1333338b7') {'for_net_delete': True} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:25:18.109729 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-ad290348-d22c-477c-9094-a9fb065d1273 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '173487ed-3830-4fbf-b2c1-18f1333338b7') {} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:25:18.118153 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffcbe60-ab4f-4bb3-a099-e19c67960e94 req-0052ba27-b16b-4cdc-8a88-a4a88d8985c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:25:18.119779 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4ffcbe60-ab4f-4bb3-a099-e19c67960e94 req-0052ba27-b16b-4cdc-8a88-a4a88d8985c4 service neutron] 10.222.0.10 "GET /v2.0/networks?id=e1e04a10-fb62-4a0a-a705-82de35b80b1b HTTP/1.1" status: 200 len: 910 time: 0.1281662 Nov 11 17:25:18.124252 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ad290348-d22c-477c-9094-a9fb065d1273 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5777070'] for segment, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:18.141727 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ad290348-d22c-477c-9094-a9fb065d1273 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:18.149330 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ad290348-d22c-477c-9094-a9fb065d1273 admin admin] Releasing vlan 515 on physical network physnet1 to pool {{(pid=102323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:25:18.149730 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ad290348-d22c-477c-9094-a9fb065d1273 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5720605'] for segment, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: Traceback (most recent call last): Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: timer() Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: cb(*args, **kw) Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: return func(*args, **kwargs) Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: self._notify() Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: self.callback(batched_events) Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: event.method(event) Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: return f(self, *a, **k) Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._get(url).json() Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: return self.request(url, 'GET', **kwargs) Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:25:18.151632 dv-cinder-694140-2-iscsi neutron-server[102323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:25:18.226506 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4ffcbe60-ab4f-4bb3-a099-e19c67960e94 req-856f8159-49f5-491a-a328-387aed84bf3f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 HTTP/1.1" status: 200 len: 1001 time: 0.0971251 Nov 11 17:25:18.280462 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffcbe60-ab4f-4bb3-a099-e19c67960e94 req-6f37160c-dabd-4bd9-94f8-e2d1c0a125db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:25:18.282046 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4ffcbe60-ab4f-4bb3-a099-e19c67960e94 req-6f37160c-dabd-4bd9-94f8-e2d1c0a125db service neutron] 10.222.0.10 "GET /v2.0/subnets?id=45e5a299-340d-4f14-b0eb-66727a394b7c HTTP/1.1" status: 200 len: 848 time: 0.0480251 Nov 11 17:25:18.302759 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ad290348-d22c-477c-9094-a9fb065d1273 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:18.310124 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ad290348-d22c-477c-9094-a9fb065d1273 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:18.315100 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-ad290348-d22c-477c-9094-a9fb065d1273 admin admin] 10.222.0.16 "DELETE /v2.0/networks/0d49ad27-76fe-421c-86d6-138a53bc5d1c HTTP/1.1" status: 204 len: 168 time: 0.4707077 Nov 11 17:25:18.328920 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad290348-d22c-477c-9094-a9fb065d1273 admin admin] Pushing event deleted for resources: {'Network': ['ID=0d49ad27-76fe-421c-86d6-138a53bc5d1c,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:25:18.341832 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffcbe60-ab4f-4bb3-a099-e19c67960e94 req-9d11ece2-3b17-4f69-8dbb-a1b7cfec5227 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:25:18.343763 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4ffcbe60-ab4f-4bb3-a099-e19c67960e94 req-9d11ece2-3b17-4f69-8dbb-a1b7cfec5227 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=e1e04a10-fb62-4a0a-a705-82de35b80b1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0542500 Nov 11 17:25:18.474155 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4ffcbe60-ab4f-4bb3-a099-e19c67960e94 req-a986f5d9-eba5-409d-9e99-8ec936122e85 service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1222842 Nov 11 17:25:18.576675 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4ffcbe60-ab4f-4bb3-a099-e19c67960e94 req-2630cf0c-a5b0-40d9-b921-72bbf12428e5 service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0948427 Nov 11 17:25:18.762122 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 37450) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:25:18.807704 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-3b226aef-6a8d-4684-a69c-349260f6fb7c admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=c02f323bd05c4d6bbbadfb2cf91bd62d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0443470 Nov 11 17:25:18.810599 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 37452) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:25:18.872172 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-cd7fff9c-3b70-43a3-ae82-980eb016960c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:18.898034 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-cd7fff9c-3b70-43a3-ae82-980eb016960c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:19.045180 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-cd7fff9c-3b70-43a3-ae82-980eb016960c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:19.048438 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-cd7fff9c-3b70-43a3-ae82-980eb016960c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:19.049822 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-cd7fff9c-3b70-43a3-ae82-980eb016960c admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/528ee871-45ec-4320-80d8-ae5c846539a7 HTTP/1.1" status: 204 len: 168 time: 0.2380736 Nov 11 17:25:19.060448 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd7fff9c-3b70-43a3-ae82-980eb016960c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=528ee871-45ec-4320-80d8-ae5c846539a7,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:25:20.921205 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 70e42819-0a8f-45db-bd4b-b7af772f04ec no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:25:20.962714 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: 70e42819-0a8f-45db-bd4b-b7af772f04ec {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:25:20.963236 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device 70e42819-0a8f-45db-bd4b-b7af772f04ec not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:25:30.947929 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c68cc5db-902d-4302-9804-69805028b7a7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:33.525377 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ccb057d6-9fd2-4c2d-b8b6-8d8acdbb2fe5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:34.626982 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:36.398604 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:37.004217 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:25:45.197535 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:25:46.951766 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:01.036706 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-57de5b43-f6f7-4220-b694-6f62d7b12329 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:03.591086 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c8a3dd9b-9b64-413a-945b-e63b6e990c42 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:04.653572 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:06.368094 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:06.996649 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:12.486656 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 37838) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:12.634668 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:12.723966 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:12.893252 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:12.933993 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=6c4e05b03cd941ea83ba240d14ae14cb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4458709 Nov 11 17:26:12.937466 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 37842) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:12.941843 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f89df99-c848-406c-a202-fd96e2a3cf43,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:12.952342 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:12.952689 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:12.953035 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:12.953373 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:12.953763 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:12.954139 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:12.954579 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:12.954838 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:12.955174 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:12.955498 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:12.955852 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:12.956188 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b35af171-2a14-4834-a4e4-d9ebf8b9a94a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:13.006478 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:13.032591 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:13.196131 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:13.198858 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:13.200382 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/1f89df99-c848-406c-a202-fd96e2a3cf43 HTTP/1.1" status: 204 len: 168 time: 0.2612085 Nov 11 17:26:13.209666 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f89df99-c848-406c-a202-fd96e2a3cf43,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:13.217736 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:13.218083 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:13.218423 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:13.223524 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:13.223524 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:13.223524 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:13.223524 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:13.223524 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:13.223524 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:13.223524 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:13.223524 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:13.223524 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c8ac522-7b17-403d-805e-e27585bc9de3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:13.938347 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 37848) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:13.953829 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bcb1930a-c141-4f80-811e-08e45d4eb9b9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:14.040759 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bcb1930a-c141-4f80-811e-08e45d4eb9b9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:14.122142 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bcb1930a-c141-4f80-811e-08e45d4eb9b9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:14.195859 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcb1930a-c141-4f80-811e-08e45d4eb9b9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f452216-7619-4aad-89e6-03fbb56345c2,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:14.201935 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-bcb1930a-c141-4f80-811e-08e45d4eb9b9 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=12d9545b6a8c4a0d9d467152ab64e9f1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2618542 Nov 11 17:26:14.206327 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 37850) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:14.263823 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-cec3f4be-d799-42ab-b74c-21764e9fc9c4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:14.288151 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-cec3f4be-d799-42ab-b74c-21764e9fc9c4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:14.476019 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-cec3f4be-d799-42ab-b74c-21764e9fc9c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:14.480975 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-cec3f4be-d799-42ab-b74c-21764e9fc9c4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:14.483432 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-cec3f4be-d799-42ab-b74c-21764e9fc9c4 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/9f452216-7619-4aad-89e6-03fbb56345c2 HTTP/1.1" status: 204 len: 168 time: 0.2776663 Nov 11 17:26:14.493900 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cec3f4be-d799-42ab-b74c-21764e9fc9c4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f452216-7619-4aad-89e6-03fbb56345c2,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:16.932914 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:18.058669 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 37922) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:18.210113 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0dae666f-ea5c-465d-abe8-71d24fb47c61 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:18.297598 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0dae666f-ea5c-465d-abe8-71d24fb47c61 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:18.361852 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-0dae666f-ea5c-465d-abe8-71d24fb47c61 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:18.402913 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dae666f-ea5c-465d-abe8-71d24fb47c61 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bdc1cb15-ef4f-4755-a092-a94c210122e5,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:18.407449 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-0dae666f-ea5c-465d-abe8-71d24fb47c61 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=9e062d62a1534c2e90db861f50559cb8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3476555 Nov 11 17:26:18.410167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 37926) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:18.466382 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3ea4d3c3-ae8c-4695-865d-f982d9060998 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:18.492352 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3ea4d3c3-ae8c-4695-865d-f982d9060998 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:18.635722 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3ea4d3c3-ae8c-4695-865d-f982d9060998 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:18.639070 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3ea4d3c3-ae8c-4695-865d-f982d9060998 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:18.640284 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-3ea4d3c3-ae8c-4695-865d-f982d9060998 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/bdc1cb15-ef4f-4755-a092-a94c210122e5 HTTP/1.1" status: 204 len: 168 time: 0.2291231 Nov 11 17:26:18.653519 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ea4d3c3-ae8c-4695-865d-f982d9060998 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bdc1cb15-ef4f-4755-a092-a94c210122e5,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:18.875085 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-434a45ed-8cbd-49f7-97d6-51d460bd70f0 req-23bb268c-6ac6-4374-a8f5-b26c64950492 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0654943 Nov 11 17:26:18.989264 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-434a45ed-8cbd-49f7-97d6-51d460bd70f0 req-8979a1ef-0558-4338-a58a-7feccc3005b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:18.990823 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-434a45ed-8cbd-49f7-97d6-51d460bd70f0 req-8979a1ef-0558-4338-a58a-7feccc3005b3 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=53c4ca7574da4b2a868a39a52a98e620&device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 1099 time: 0.0595579 Nov 11 17:26:19.119199 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-434a45ed-8cbd-49f7-97d6-51d460bd70f0 req-4e8c31b1-355b-42b3-af87-163409598130 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:19.122742 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-434a45ed-8cbd-49f7-97d6-51d460bd70f0 req-4e8c31b1-355b-42b3-af87-163409598130 service neutron] 10.222.0.10 "GET /v2.0/networks?id=e1e04a10-fb62-4a0a-a705-82de35b80b1b HTTP/1.1" status: 200 len: 910 time: 0.1034403 Nov 11 17:26:19.205897 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-434a45ed-8cbd-49f7-97d6-51d460bd70f0 req-0be51e95-ad39-4c11-ab58-905d446349b9 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 HTTP/1.1" status: 200 len: 1001 time: 0.0727930 Nov 11 17:26:19.276485 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-434a45ed-8cbd-49f7-97d6-51d460bd70f0 req-37940617-a3fa-4d60-84f6-ebdb812dd8d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:19.279246 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-434a45ed-8cbd-49f7-97d6-51d460bd70f0 req-37940617-a3fa-4d60-84f6-ebdb812dd8d4 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=45e5a299-340d-4f14-b0eb-66727a394b7c HTTP/1.1" status: 200 len: 848 time: 0.0610042 Nov 11 17:26:19.333857 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-434a45ed-8cbd-49f7-97d6-51d460bd70f0 req-645994f7-5154-4988-bc94-0ed22a946640 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:19.335413 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-434a45ed-8cbd-49f7-97d6-51d460bd70f0 req-645994f7-5154-4988-bc94-0ed22a946640 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=e1e04a10-fb62-4a0a-a705-82de35b80b1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0445890 Nov 11 17:26:19.406153 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 37932) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:19.421086 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ebdcecde-2084-4578-afb4-6f967322221b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:19.447420 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-434a45ed-8cbd-49f7-97d6-51d460bd70f0 req-202cecb3-9c47-412b-a672-3c11ef1a232b service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0994458 Nov 11 17:26:19.529573 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ebdcecde-2084-4578-afb4-6f967322221b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:19.557426 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-434a45ed-8cbd-49f7-97d6-51d460bd70f0 req-75f5699b-6520-4163-89b9-45a070afbc76 service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0981956 Nov 11 17:26:19.658457 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ebdcecde-2084-4578-afb4-6f967322221b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:19.709126 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-ebdcecde-2084-4578-afb4-6f967322221b admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=fd048d1d39c44b9fa99c575fd865a58d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3017020 Nov 11 17:26:19.709889 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebdcecde-2084-4578-afb4-6f967322221b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=863eff98-0f38-4407-aa52-4a3c3acc39d4,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:19.712293 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 37934) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:19.774881 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b490e7a3-1488-45f1-ae2b-eb1c739c2011 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:19.801214 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b490e7a3-1488-45f1-ae2b-eb1c739c2011 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:19.938684 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b490e7a3-1488-45f1-ae2b-eb1c739c2011 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:19.941644 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b490e7a3-1488-45f1-ae2b-eb1c739c2011 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:19.943132 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-b490e7a3-1488-45f1-ae2b-eb1c739c2011 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/863eff98-0f38-4407-aa52-4a3c3acc39d4 HTTP/1.1" status: 204 len: 168 time: 0.2296579 Nov 11 17:26:19.953910 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b490e7a3-1488-45f1-ae2b-eb1c739c2011 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=863eff98-0f38-4407-aa52-4a3c3acc39d4,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:22.196257 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:26:30.949317 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-d89c8629-ebc3-4f0c-8001-b66e97a43fea None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:32.438281 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38022) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:32.583199 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-abbf320b-4858-462c-a0a4-52fc95d49e12 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:32.667054 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-abbf320b-4858-462c-a0a4-52fc95d49e12 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:32.783514 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-abbf320b-4858-462c-a0a4-52fc95d49e12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:32.827673 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abbf320b-4858-462c-a0a4-52fc95d49e12 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6d72a7c-f0ae-4cad-8375-a49a4131ee72,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:32.832936 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-abbf320b-4858-462c-a0a4-52fc95d49e12 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=eed77ad242b64dd599a705fab96e7639&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3928308 Nov 11 17:26:32.836784 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38028) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:32.909815 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fd3f4939-4921-4013-81e6-68a9c1282712 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:32.938502 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fd3f4939-4921-4013-81e6-68a9c1282712 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:33.075209 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fd3f4939-4921-4013-81e6-68a9c1282712 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:33.078082 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-fd3f4939-4921-4013-81e6-68a9c1282712 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:33.079352 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-fd3f4939-4921-4013-81e6-68a9c1282712 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/e6d72a7c-f0ae-4cad-8375-a49a4131ee72 HTTP/1.1" status: 204 len: 168 time: 0.2415853 Nov 11 17:26:33.088299 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd3f4939-4921-4013-81e6-68a9c1282712 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6d72a7c-f0ae-4cad-8375-a49a4131ee72,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:33.532112 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-47d1c407-2d91-4bbc-9839-ba947597a529 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:34.714263 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:34.971237 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38058) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:35.085053 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-46705775-bf66-4d7b-8706-930bbc7e0d25 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:35.172965 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-46705775-bf66-4d7b-8706-930bbc7e0d25 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:35.257225 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-46705775-bf66-4d7b-8706-930bbc7e0d25 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:35.300747 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-46705775-bf66-4d7b-8706-930bbc7e0d25 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=ce126ca5a78d4828a1758164b186cb65&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3280144 Nov 11 17:26:35.301498 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46705775-bf66-4d7b-8706-930bbc7e0d25 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b9555dba-4d13-48c1-b688-162f7418f5ae,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:35.304195 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38062) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:35.360774 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-790b3daf-a88a-48af-a31d-c5af71907c0e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:35.385520 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-790b3daf-a88a-48af-a31d-c5af71907c0e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:35.514101 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-790b3daf-a88a-48af-a31d-c5af71907c0e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:35.516680 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-790b3daf-a88a-48af-a31d-c5af71907c0e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:35.517936 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-790b3daf-a88a-48af-a31d-c5af71907c0e admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/b9555dba-4d13-48c1-b688-162f7418f5ae HTTP/1.1" status: 204 len: 168 time: 0.2118504 Nov 11 17:26:35.526774 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-790b3daf-a88a-48af-a31d-c5af71907c0e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b9555dba-4d13-48c1-b688-162f7418f5ae,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:36.394654 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:36.724354 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38084) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:36.857351 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-be839e8e-f66e-4124-95d8-c562b5ebfc62 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-910390135-network', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:26:36.959581 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be839e8e-f66e-4124-95d8-c562b5ebfc62 admin admin] Made reservation on behalf of 0918d6b635a04c89ae9c7253d1a3901f for: {'network': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:26:36.962177 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-be839e8e-f66e-4124-95d8-c562b5ebfc62 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:36.971856 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-be839e8e-f66e-4124-95d8-c562b5ebfc62 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:37.034097 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:37.052040 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-be839e8e-f66e-4124-95d8-c562b5ebfc62 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:37.126010 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-be839e8e-f66e-4124-95d8-c562b5ebfc62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:37.155917 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-be839e8e-f66e-4124-95d8-c562b5ebfc62 admin admin] vlan segment allocate from pool success with {'vlan_id': 534, 'physical_network': 'physnet1'} {{(pid=102324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:26:37.167461 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be839e8e-f66e-4124-95d8-c562b5ebfc62 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6f2f987-e7b7-4ed2-ae1e-736f35635781,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:37.173173 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-be839e8e-f66e-4124-95d8-c562b5ebfc62 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:37.173574 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.segments_db [None req-be839e8e-f66e-4124-95d8-c562b5ebfc62 admin admin] Added segment 228b04b9-98b7-47bd-a901-1be44f34a0f9 of type vlan for network 892c147f-3343-4b08-a9a7-9e968821be86 Nov 11 17:26:37.221597 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-be839e8e-f66e-4124-95d8-c562b5ebfc62 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:37.316313 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-be839e8e-f66e-4124-95d8-c562b5ebfc62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:37.317420 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be839e8e-f66e-4124-95d8-c562b5ebfc62 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:37.318017 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-be839e8e-f66e-4124-95d8-c562b5ebfc62 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:37.382760 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be839e8e-f66e-4124-95d8-c562b5ebfc62 admin admin] Pushing event updated for resources: {'Network': ['ID=892c147f-3343-4b08-a9a7-9e968821be86,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:37.394709 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network 892c147f-3343-4b08-a9a7-9e968821be86 details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:26:37.431249 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-be839e8e-f66e-4124-95d8-c562b5ebfc62 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.7056355 Nov 11 17:26:37.436228 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38088) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:37.441874 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-cea2b6af-7022-4d71-bbc5-d0030e0ec3e5 admin admin] Request body: {'subnet': {'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-910390135-subnet', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'ip_version': 4}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:26:37.537154 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cea2b6af-7022-4d71-bbc5-d0030e0ec3e5 admin admin] Made reservation on behalf of 0918d6b635a04c89ae9c7253d1a3901f for: {'subnet': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:26:37.539917 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-cea2b6af-7022-4d71-bbc5-d0030e0ec3e5 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5275488'] for subnet, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:37.794967 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-cea2b6af-7022-4d71-bbc5-d0030e0ec3e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5436401', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5275470'] for subnet, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:37.860082 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea2b6af-7022-4d71-bbc5-d0030e0ec3e5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=44d8c516-d4c3-4d4e-81bb-be7d2f3122ab,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:37.871925 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cea2b6af-7022-4d71-bbc5-d0030e0ec3e5 admin admin] Checking segment: {'id': '228b04b9-98b7-47bd-a901-1be44f34a0f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 534, 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:26:37.871925 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cea2b6af-7022-4d71-bbc5-d0030e0ec3e5 admin admin] Network hostable DHCP agents. Network: 892c147f-3343-4b08-a9a7-9e968821be86, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:26:37.948815 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cea2b6af-7022-4d71-bbc5-d0030e0ec3e5 admin admin] Network 892c147f-3343-4b08-a9a7-9e968821be86 is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:26:38.023265 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-cea2b6af-7022-4d71-bbc5-d0030e0ec3e5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, 892c147f-3343-4b08-a9a7-9e968821be86) {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:26:38.029018 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cea2b6af-7022-4d71-bbc5-d0030e0ec3e5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:38.029622 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-cea2b6af-7022-4d71-bbc5-d0030e0ec3e5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:38.035298 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-498b2389-860b-40aa-96b9-979999998766 None None] Network 892c147f-3343-4b08-a9a7-9e968821be86 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:26:38.120795 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-cea2b6af-7022-4d71-bbc5-d0030e0ec3e5 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.6792812 Nov 11 17:26:38.121125 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38090) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:38.125689 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-910390135-router', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:26:38.208330 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaac6311d-333a-5f5f-a33c-91960009c34a-892c147f-3343-4b08-a9a7-9e968821be86', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'fixed_ips': [{'subnet_id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab'}]}} from dv-cinder-694140-2-iscsi. {{(pid=102325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 17:26:38.209295 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:38.212441 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-424378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7339'] for router, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:38.214230 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-424390', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-397156', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7867629', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7328'] for router, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:38.286581 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:38.362967 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.db_base_plugin_common [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Allocated IP 172.20.0.2 (892c147f-3343-4b08-a9a7-9e968821be86/44d8c516-d4c3-4d4e-81bb-be7d2f3122ab/dc8d333c-43a3-4431-805f-02ea3c9f0efd) {{(pid=102325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:26:38.600074 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Publish callbacks [] for port, precommit_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:38.680928 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624'] for port, after_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:38.728453 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Network 892c147f-3343-4b08-a9a7-9e968821be86 is already hosted by enough agents. {{(pid=102325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:26:38.732143 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.base_scheduler [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Resources bound (agent type, host, resource id): {{(pid=102325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:26:38.738056 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Received port after_create {{(pid=102325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:26:38.748101 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Pushing event updated for resources: {'Port': ['ID=dc8d333c-43a3-4431-805f-02ea3c9f0efd,revision_number=1']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:38.779274 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:38.779865 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:38.780451 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:38.780846 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:38.781231 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:38.781650 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:38.782116 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:38.782602 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:38.783060 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:38.783511 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:38.783950 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:38.784415 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:38.803457 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:38.826466 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Attempting to bind port dc8d333c-43a3-4431-805f-02ea3c9f0efd on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:26:38.826944 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Attempting to bind port dc8d333c-43a3-4431-805f-02ea3c9f0efd by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '228b04b9-98b7-47bd-a901-1be44f34a0f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 534, 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:26:38.827307 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Attempting to bind port dc8d333c-43a3-4431-805f-02ea3c9f0efd on network 892c147f-3343-4b08-a9a7-9e968821be86 {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:26:38.833366 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 26, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:26:38.833736 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Checking segment: {'id': '228b04b9-98b7-47bd-a901-1be44f34a0f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 534, 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:26:38.834138 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:38.834528 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Bound using segment: {'id': '228b04b9-98b7-47bd-a901-1be44f34a0f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 534, 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:26:38.835371 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Bound port: dc8d333c-43a3-4431-805f-02ea3c9f0efd, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '228b04b9-98b7-47bd-a901-1be44f34a0f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 534, 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:26:38.835821 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:38.909946 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] For port dc8d333c-43a3-4431-805f-02ea3c9f0efd, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:26:38.915787 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] For port dc8d333c-43a3-4431-805f-02ea3c9f0efd, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=dc8d333c-43a3-4431-805f-02ea3c9f0efd,segment=NetworkSegment(228b04b9-98b7-47bd-a901-1be44f34a0f9),segment_id=228b04b9-98b7-47bd-a901-1be44f34a0f9)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:26:39.024150 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:39.136203 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:39.136452 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6322b12-2a81-44d3-88a6-2b97a23773ed None None] Pushing event updated for resources: {'Port': ['ID=dc8d333c-43a3-4431-805f-02ea3c9f0efd,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:39.161558 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:39.328673 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Allocated IP 172.27.1.123 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/ec14a758-cddf-496c-98e0-e73ad442a6ad) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:26:39.471647 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:39.582964 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:39.621954 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:26:39.625594 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:26:39.637348 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:26:39.672741 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Pushing event updated for resources: {'Port': ['ID=ec14a758-cddf-496c-98e0-e73ad442a6ad,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:39.748815 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device dc8d333c-43a3-4431-805f-02ea3c9f0efd up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:26:39.822056 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port dc8d333c-43a3-4431-805f-02ea3c9f0efd triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:39.822845 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:39.928198 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:39.994100 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] For port dc8d333c-43a3-4431-805f-02ea3c9f0efd, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=dc8d333c-43a3-4431-805f-02ea3c9f0efd,segment=NetworkSegment(228b04b9-98b7-47bd-a901-1be44f34a0f9),segment_id=228b04b9-98b7-47bd-a901-1be44f34a0f9)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:26:40.048999 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:40.062700 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:40.133394 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Pushing event updated for resources: {'Port': ['ID=dc8d333c-43a3-4431-805f-02ea3c9f0efd,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:40.192672 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a70e439-d3f3-4d99-914d-b7c4be597755 None None] Network 892c147f-3343-4b08-a9a7-9e968821be86 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:26:40.322653 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-9f90057f-f335-4cd7-9410-9b5f557d554f None None] Provisioning complete for port dc8d333c-43a3-4431-805f-02ea3c9f0efd triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:40.323045 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-9f90057f-f335-4cd7-9410-9b5f557d554f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:40.337749 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-424501', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-397235'] for router, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:40.685651 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Router 0f921ab3-c03d-4722-9f80-7301a23dc466 is scheduled to L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 with binding_index 1 {{(pid=102324) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 17:26:40.693746 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-544ace05-2b73-4f77-836a-0b9a066b80e6 None None] Provisioning complete for port dc8d333c-43a3-4431-805f-02ea3c9f0efd triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:40.694026 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-544ace05-2b73-4f77-836a-0b9a066b80e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:40.802357 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:26:40.813300 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Sync routers for ids ['0f921ab3-c03d-4722-9f80-7301a23dc466'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:26:40.824434 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Routers {'0f921ab3-c03d-4722-9f80-7301a23dc466'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:26:40.825027 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:26:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['0f921ab3-c03d-4722-9f80-7301a23dc466'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:26:40.923061 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] Publish callbacks [] for router, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:40.924779 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-c9da2eb0-504b-4087-b24a-9c98a4cddbb6 admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.8025916 Nov 11 17:26:40.928039 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38092) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:41.068480 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Set router 0f921ab3-c03d-4722-9f80-7301a23dc466 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:26:41.300689 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'name': 'tempest-TestMinimumBasicScenario-910390135-router', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:38Z', 'updated_at': '2021-11-11T17:26:39Z', 'revision_number': 3, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'gw_port': {'id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:7a:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:39Z', 'updated_at': '2021-11-11T17:26:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:26:41.334309 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Checking router: 0f921ab3-c03d-4722-9f80-7301a23dc466 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:26:41.334688 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Updating router 0f921ab3-c03d-4722-9f80-7301a23dc466 port ec14a758-cddf-496c-98e0-e73ad442a6ad binding host dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:26:41.361615 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:41.451956 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:41.655572 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Allocated IP 172.20.0.1 (892c147f-3343-4b08-a9a7-9e968821be86/44d8c516-d4c3-4d4e-81bb-be7d2f3122ab/47ad1537-84e2-4b23-9edf-269b2ea4d931) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:26:41.715093 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device dc8d333c-43a3-4431-805f-02ea3c9f0efd up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:26:41.756695 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Publish callbacks [] for port, precommit_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:41.773451 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:41.810570 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port dc8d333c-43a3-4431-805f-02ea3c9f0efd triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:41.811250 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:41.854460 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:41.908852 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:41.959078 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Network 892c147f-3343-4b08-a9a7-9e968821be86 is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:26:41.962413 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:26:41.967589 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:26:41.987897 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Attempting to bind port ec14a758-cddf-496c-98e0-e73ad442a6ad on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:26:41.988540 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Attempting to bind port ec14a758-cddf-496c-98e0-e73ad442a6ad by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:26:41.989172 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Attempting to bind port ec14a758-cddf-496c-98e0-e73ad442a6ad on network 78b17769-6fae-453e-8ae3-4a72e72bccfc {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:26:41.998351 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fd4c344-4123-46b2-be89-af2d80352c4d None None] Pushing event updated for resources: {'Port': ['ID=ec14a758-cddf-496c-98e0-e73ad442a6ad,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:42.000657 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Pushing event updated for resources: {'Port': ['ID=47ad1537-84e2-4b23-9edf-269b2ea4d931,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:42.008329 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 26, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:26:42.008965 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Checking segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:26:42.009598 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:42.010261 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Bound using segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:26:42.011141 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Bound port: ec14a758-cddf-496c-98e0-e73ad442a6ad, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:26:42.011849 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:42.020065 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-394084'] for router_interface, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:42.152661 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] For port ec14a758-cddf-496c-98e0-e73ad442a6ad, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:26:42.161905 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] For port ec14a758-cddf-496c-98e0-e73ad442a6ad, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=ec14a758-cddf-496c-98e0-e73ad442a6ad,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:26:42.234510 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:42.283087 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:42.300833 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Routers {'0f921ab3-c03d-4722-9f80-7301a23dc466'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:26:42.305243 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:26:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['0f921ab3-c03d-4722-9f80-7301a23dc466'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:26:42.306103 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fd4c344-4123-46b2-be89-af2d80352c4d None None] Pushing event updated for resources: {'Port': ['ID=ec14a758-cddf-496c-98e0-e73ad442a6ad,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:42.395794 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-f3283445-1743-43a2-b2a0-5b9fed46762c None None] Provisioning complete for port 47ad1537-84e2-4b23-9edf-269b2ea4d931 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:42.396185 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-f3283445-1743-43a2-b2a0-5b9fed46762c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:42.479425 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-f3283445-1743-43a2-b2a0-5b9fed46762c None None] Port 47ad1537-84e2-4b23-9edf-269b2ea4d931 cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:26:42.492999 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] Set router 0f921ab3-c03d-4722-9f80-7301a23dc466 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:26:42.559560 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:42.633547 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:42.739173 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Pushing event updated for resources: {'Port': ['ID=47ad1537-84e2-4b23-9edf-269b2ea4d931,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:42.743079 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8103788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-394224'] for router_interface, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:42.757503 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'name': 'tempest-TestMinimumBasicScenario-910390135-router', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:38Z', 'updated_at': '2021-11-11T17:26:42Z', 'revision_number': 4, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'gw_port': {'id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:7a:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:39Z', 'updated_at': '2021-11-11T17:26:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '47ad1537-84e2-4b23-9edf-269b2ea4d931', 'name': '', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'mac_address': 'fa:16:3e:a2:83:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:41Z', 'updated_at': '2021-11-11T17:26:41Z', 'revision_number': 1, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'subnets': [{'id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:26:42.791730 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a00a1779-0a51-4abf-aee5-524c66cc4356 None None] The sync data for ids ['0f921ab3-c03d-4722-9f80-7301a23dc466'] in dv-cinder-694140-2-iscsi is: [{'id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'name': 'tempest-TestMinimumBasicScenario-910390135-router', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:38Z', 'updated_at': '2021-11-11T17:26:42Z', 'revision_number': 4, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'gw_port': {'id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:7a:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:39Z', 'updated_at': '2021-11-11T17:26:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '47ad1537-84e2-4b23-9edf-269b2ea4d931', 'name': '', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'mac_address': 'fa:16:3e:a2:83:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:41Z', 'updated_at': '2021-11-11T17:26:41Z', 'revision_number': 1, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'subnets': [{'id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:26:42.894164 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Network 892c147f-3343-4b08-a9a7-9e968821be86 is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:26:42.896328 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:26:43.096627 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Router 0f921ab3-c03d-4722-9f80-7301a23dc466 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:26:43.255201 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:26:43.260694 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-253d5a8b-de81-450a-95c5-6bc9345de2dd admin admin] 10.222.0.16 "PUT /v2.0/routers/0f921ab3-c03d-4722-9f80-7301a23dc466/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3314583 Nov 11 17:26:43.316093 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-7185d13f-fff8-4b7a-a67e-f05a859aabc3 None None] Provisioning complete for port 47ad1537-84e2-4b23-9edf-269b2ea4d931 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:43.320263 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-7185d13f-fff8-4b7a-a67e-f05a859aabc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:43.356300 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-7185d13f-fff8-4b7a-a67e-f05a859aabc3 None None] Port 47ad1537-84e2-4b23-9edf-269b2ea4d931 cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:26:43.767480 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device ec14a758-cddf-496c-98e0-e73ad442a6ad up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:26:43.829826 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port ec14a758-cddf-496c-98e0-e73ad442a6ad triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:43.830201 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:43.938431 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:43.962434 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] For port ec14a758-cddf-496c-98e0-e73ad442a6ad, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=ec14a758-cddf-496c-98e0-e73ad442a6ad,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:26:44.051470 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:44.133068 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Pushing event updated for resources: {'Port': ['ID=ec14a758-cddf-496c-98e0-e73ad442a6ad,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:44.256368 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba1a20f3-0d72-4eff-bd54-b324d90c5bfe req-2e879708-e12c-467b-bdc6-bc6802cd7df2 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:44.258030 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ba1a20f3-0d72-4eff-bd54-b324d90c5bfe req-2e879708-e12c-467b-bdc6-bc6802cd7df2 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.0576675 Nov 11 17:26:44.313720 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38116) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:44.318882 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-747697ea-e9ac-451e-88e1-1f8b6350c706 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1633009201-network', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:26:44.325643 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ba1a20f3-0d72-4eff-bd54-b324d90c5bfe req-25a679f5-722a-4b92-a3de-71fccf01a682 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0609832 Nov 11 17:26:44.422374 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-747697ea-e9ac-451e-88e1-1f8b6350c706 admin admin] Made reservation on behalf of 3130da64ca90454cbfe95cf315e224fb for: {'network': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:26:44.425018 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-747697ea-e9ac-451e-88e1-1f8b6350c706 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for network, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:44.434687 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-747697ea-e9ac-451e-88e1-1f8b6350c706 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:44.521244 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-747697ea-e9ac-451e-88e1-1f8b6350c706 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:44.685712 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-747697ea-e9ac-451e-88e1-1f8b6350c706 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:44.717035 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-747697ea-e9ac-451e-88e1-1f8b6350c706 admin admin] vlan segment allocate from pool success with {'vlan_id': 543, 'physical_network': 'physnet1'} {{(pid=102324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 17:26:44.724042 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-747697ea-e9ac-451e-88e1-1f8b6350c706 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=011addfb-1e67-49e1-92cc-581350960f47,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:44.732816 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-747697ea-e9ac-451e-88e1-1f8b6350c706 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:44.733173 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.segments_db [None req-747697ea-e9ac-451e-88e1-1f8b6350c706 admin admin] Added segment e90a3aab-14f8-47af-bc48-1ed099ffa30c of type vlan for network 85f429c8-7dd6-424d-bd82-58d9de8bbd92 Nov 11 17:26:44.780655 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-747697ea-e9ac-451e-88e1-1f8b6350c706 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8735338097866'] for network, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:44.868467 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-747697ea-e9ac-451e-88e1-1f8b6350c706 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838'] for network, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:44.869660 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-747697ea-e9ac-451e-88e1-1f8b6350c706 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:44.871437 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-747697ea-e9ac-451e-88e1-1f8b6350c706 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:44.944859 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-747697ea-e9ac-451e-88e1-1f8b6350c706 admin admin] Pushing event updated for resources: {'Network': ['ID=85f429c8-7dd6-424d-bd82-58d9de8bbd92,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:44.957213 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Network 85f429c8-7dd6-424d-bd82-58d9de8bbd92 details requested by agent ovs-agent-dv-cinder-694140-2-iscsi with host dv-cinder-694140-2-iscsi {{(pid=102325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 17:26:44.997565 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-747697ea-e9ac-451e-88e1-1f8b6350c706 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.6824734 Nov 11 17:26:45.000093 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38118) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:45.005077 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-1c8b6089-7565-4ae1-9618-ed3c6777f738 admin admin] Request body: {'subnet': {'network_id': '85f429c8-7dd6-424d-bd82-58d9de8bbd92', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1633009201-subnet', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'ip_version': 4}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:26:45.114078 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1c8b6089-7565-4ae1-9618-ed3c6777f738 admin admin] Made reservation on behalf of 3130da64ca90454cbfe95cf315e224fb for: {'subnet': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:26:45.116952 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-1c8b6089-7565-4ae1-9618-ed3c6777f738 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5275488'] for subnet, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:45.158914 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Sync routers for ids ['0f921ab3-c03d-4722-9f80-7301a23dc466'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:26:45.176916 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Routers {'0f921ab3-c03d-4722-9f80-7301a23dc466'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:26:45.177923 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:26:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['0f921ab3-c03d-4722-9f80-7301a23dc466'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:26:45.326955 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Set router 0f921ab3-c03d-4722-9f80-7301a23dc466 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:26:45.423922 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-1c8b6089-7565-4ae1-9618-ed3c6777f738 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5436401', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5275470'] for subnet, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:45.587765 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c8b6089-7565-4ae1-9618-ed3c6777f738 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2d507788-8511-49e5-8d1c-7289c3ccf113,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:45.641200 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d6e091-c507-4b31-b2ec-a44572c08431 req-4dd1fc91-2773-4459-88ba-617ba87af324 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:45.644373 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-06d6e091-c507-4b31-b2ec-a44572c08431 req-4dd1fc91-2773-4459-88ba-617ba87af324 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.1767309 Nov 11 17:26:45.645984 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c8b6089-7565-4ae1-9618-ed3c6777f738 admin admin] Checking segment: {'id': 'e90a3aab-14f8-47af-bc48-1ed099ffa30c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': '85f429c8-7dd6-424d-bd82-58d9de8bbd92'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:26:45.646626 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c8b6089-7565-4ae1-9618-ed3c6777f738 admin admin] Network hostable DHCP agents. Network: 85f429c8-7dd6-424d-bd82-58d9de8bbd92, hostable agents: ['b44a3b1b-0af4-4fad-a3a3-aea320387229'], hosted agents: [] {{(pid=102324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 17:26:45.678066 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'name': 'tempest-TestMinimumBasicScenario-910390135-router', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:38Z', 'updated_at': '2021-11-11T17:26:42Z', 'revision_number': 4, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'gw_port': {'id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:7a:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:39Z', 'updated_at': '2021-11-11T17:26:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '47ad1537-84e2-4b23-9edf-269b2ea4d931', 'name': '', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'mac_address': 'fa:16:3e:a2:83:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:41Z', 'updated_at': '2021-11-11T17:26:42Z', 'revision_number': 2, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'subnets': [{'id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:26:45.695075 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device ec14a758-cddf-496c-98e0-e73ad442a6ad up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:26:45.726423 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Checking router: 0f921ab3-c03d-4722-9f80-7301a23dc466 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:26:45.726836 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Updating router 0f921ab3-c03d-4722-9f80-7301a23dc466 port 47ad1537-84e2-4b23-9edf-269b2ea4d931 binding host dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:26:45.763050 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:45.764374 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port ec14a758-cddf-496c-98e0-e73ad442a6ad triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:45.765122 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:46.086774 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Publish callbacks [] for port, precommit_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:46.148605 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:46.181130 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-06d6e091-c507-4b31-b2ec-a44572c08431 req-b4eee414-b521-4895-80a8-fe2cdf0b4e98 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.5278184 Nov 11 17:26:46.212079 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c8b6089-7565-4ae1-9618-ed3c6777f738 admin admin] Network 85f429c8-7dd6-424d-bd82-58d9de8bbd92 is scheduled to be hosted by DHCP agent b44a3b1b-0af4-4fad-a3a3-aea320387229 with binding_index 1 {{(pid=102324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 17:26:46.234122 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c213159d-2a8a-488f-9bf6-36de34fe362b None None] Pushing event updated for resources: {'Port': ['ID=47ad1537-84e2-4b23-9edf-269b2ea4d931,revision_number=3']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:46.267698 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c213159d-2a8a-488f-9bf6-36de34fe362b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:46.268109 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c213159d-2a8a-488f-9bf6-36de34fe362b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:46.268449 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c213159d-2a8a-488f-9bf6-36de34fe362b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:46.268775 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c213159d-2a8a-488f-9bf6-36de34fe362b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:46.269194 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c213159d-2a8a-488f-9bf6-36de34fe362b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:46.269525 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c213159d-2a8a-488f-9bf6-36de34fe362b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:46.270030 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c213159d-2a8a-488f-9bf6-36de34fe362b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:46.270487 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c213159d-2a8a-488f-9bf6-36de34fe362b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:46.270854 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c213159d-2a8a-488f-9bf6-36de34fe362b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:46.271270 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c213159d-2a8a-488f-9bf6-36de34fe362b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:46.271814 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c213159d-2a8a-488f-9bf6-36de34fe362b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:46.272404 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c213159d-2a8a-488f-9bf6-36de34fe362b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:26:46.313651 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-1c8b6089-7565-4ae1-9618-ed3c6777f738 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-694140-2-iscsi, 85f429c8-7dd6-424d-bd82-58d9de8bbd92) {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:26:46.318265 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c8b6089-7565-4ae1-9618-ed3c6777f738 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:46.319068 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-1c8b6089-7565-4ae1-9618-ed3c6777f738 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for subnet, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:46.328785 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Attempting to bind port 47ad1537-84e2-4b23-9edf-269b2ea4d931 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:26:46.329191 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Attempting to bind port 47ad1537-84e2-4b23-9edf-269b2ea4d931 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '228b04b9-98b7-47bd-a901-1be44f34a0f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 534, 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86'}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:26:46.329487 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d02aa80-2a44-4281-a73e-1d0ae7bf84aa None None] Network 85f429c8-7dd6-424d-bd82-58d9de8bbd92 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:26:46.329991 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Attempting to bind port 47ad1537-84e2-4b23-9edf-269b2ea4d931 on network 892c147f-3343-4b08-a9a7-9e968821be86 {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:26:46.337428 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 26, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:26:46.338291 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Checking segment: {'id': '228b04b9-98b7-47bd-a901-1be44f34a0f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 534, 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:26:46.338501 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:46.338932 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Bound using segment: {'id': '228b04b9-98b7-47bd-a901-1be44f34a0f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 534, 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86'} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:26:46.339953 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Bound port: 47ad1537-84e2-4b23-9edf-269b2ea4d931, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '228b04b9-98b7-47bd-a901-1be44f34a0f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 534, 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86'}}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:26:46.340351 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:46.436556 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-1c8b6089-7565-4ae1-9618-ed3c6777f738 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.4350019 Nov 11 17:26:46.439093 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38122) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:46.448991 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] For port 47ad1537-84e2-4b23-9edf-269b2ea4d931, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:26:46.451738 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1633009201-router', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:26:46.454009 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] For port 47ad1537-84e2-4b23-9edf-269b2ea4d931, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=47ad1537-84e2-4b23-9edf-269b2ea4d931,segment=NetworkSegment(228b04b9-98b7-47bd-a901-1be44f34a0f9),segment_id=228b04b9-98b7-47bd-a901-1be44f34a0f9)] {{(pid=102326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:26:46.527530 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-7e6f8edd-e160-41c6-aa1b-ef97b0d91527 None None] Provisioning complete for port 47ad1537-84e2-4b23-9edf-269b2ea4d931 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:46.527837 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-7e6f8edd-e160-41c6-aa1b-ef97b0d91527 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:46.531747 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:46.566243 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-424378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7339'] for router, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:46.567423 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaac6311d-333a-5f5f-a33c-91960009c34a-85f429c8-7dd6-424d-bd82-58d9de8bbd92', 'network_id': '85f429c8-7dd6-424d-bd82-58d9de8bbd92', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'fixed_ips': [{'subnet_id': '2d507788-8511-49e5-8d1c-7289c3ccf113'}]}} from dv-cinder-694140-2-iscsi. {{(pid=102325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 17:26:46.568307 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:46.568557 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-424390', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-397156', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7867629', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7328'] for router, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:46.620139 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Routers {'0f921ab3-c03d-4722-9f80-7301a23dc466'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:26:46.621467 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:26:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['0f921ab3-c03d-4722-9f80-7301a23dc466'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:26:46.687116 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:46.734744 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c213159d-2a8a-488f-9bf6-36de34fe362b None None] Pushing event updated for resources: {'Port': ['ID=47ad1537-84e2-4b23-9edf-269b2ea4d931,revision_number=4']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:46.866172 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] Set router 0f921ab3-c03d-4722-9f80-7301a23dc466 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:26:46.932018 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.db_base_plugin_common [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Allocated IP 172.20.0.2 (85f429c8-7dd6-424d-bd82-58d9de8bbd92/2d507788-8511-49e5-8d1c-7289c3ccf113/3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b) {{(pid=102325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:26:46.935593 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-7e6f8edd-e160-41c6-aa1b-ef97b0d91527 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:47.003234 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-7e6f8edd-e160-41c6-aa1b-ef97b0d91527 None None] For port 47ad1537-84e2-4b23-9edf-269b2ea4d931, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=47ad1537-84e2-4b23-9edf-269b2ea4d931,segment=NetworkSegment(228b04b9-98b7-47bd-a901-1be44f34a0f9),segment_id=228b04b9-98b7-47bd-a901-1be44f34a0f9)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:26:47.007895 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:47.045234 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:47.080329 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-7e6f8edd-e160-41c6-aa1b-ef97b0d91527 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:47.175887 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'name': 'tempest-TestMinimumBasicScenario-910390135-router', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:38Z', 'updated_at': '2021-11-11T17:26:42Z', 'revision_number': 4, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'gw_port': {'id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:7a:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:39Z', 'updated_at': '2021-11-11T17:26:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '47ad1537-84e2-4b23-9edf-269b2ea4d931', 'name': '', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'mac_address': 'fa:16:3e:a2:83:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:41Z', 'updated_at': '2021-11-11T17:26:46Z', 'revision_number': 4, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'subnets': [{'id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:26:47.208644 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d54dfa1-93b0-4ad8-9bb3-5533550ddd5e None None] The sync data for ids ['0f921ab3-c03d-4722-9f80-7301a23dc466'] in dv-cinder-694140-2-iscsi is: [{'id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'name': 'tempest-TestMinimumBasicScenario-910390135-router', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:38Z', 'updated_at': '2021-11-11T17:26:42Z', 'revision_number': 4, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'gw_port': {'id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:7a:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:39Z', 'updated_at': '2021-11-11T17:26:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '47ad1537-84e2-4b23-9edf-269b2ea4d931', 'name': '', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'mac_address': 'fa:16:3e:a2:83:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:41Z', 'updated_at': '2021-11-11T17:26:46Z', 'revision_number': 4, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'subnets': [{'id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:26:47.246582 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-dab23587-ebd8-4dc1-9626-96d757d66ec7 None None] Provisioning complete for port 47ad1537-84e2-4b23-9edf-269b2ea4d931 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:47.246975 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-dab23587-ebd8-4dc1-9626-96d757d66ec7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:47.255298 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e6f8edd-e160-41c6-aa1b-ef97b0d91527 None None] Pushing event updated for resources: {'Port': ['ID=47ad1537-84e2-4b23-9edf-269b2ea4d931,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:47.316666 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Publish callbacks [] for port, precommit_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:47.337402 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9299b46-a4e3-41fe-8614-8b935682170f req-9e39710a-04e7-4fbe-9b93-8c626c0ebe5c tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:47.339117 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b9299b46-a4e3-41fe-8614-8b935682170f req-9e39710a-04e7-4fbe-9b93-8c626c0ebe5c tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.0625482 Nov 11 17:26:47.413929 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:47.414531 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624'] for port, after_create {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:47.417647 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b9299b46-a4e3-41fe-8614-8b935682170f req-6e9010a2-9f6d-4570-aa84-3c86db27bca4 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0693257 Nov 11 17:26:47.449023 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:47.503327 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Network 85f429c8-7dd6-424d-bd82-58d9de8bbd92 is already hosted by enough agents. {{(pid=102325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:26:47.513203 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.scheduler.base_scheduler [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Resources bound (agent type, host, resource id): {{(pid=102325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:26:47.522033 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Received port after_create {{(pid=102325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:26:47.528497 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Pushing event updated for resources: {'Port': ['ID=3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b,revision_number=1']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:47.592089 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Attempting to bind port 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:26:47.592464 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Attempting to bind port 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': 'e90a3aab-14f8-47af-bc48-1ed099ffa30c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': '85f429c8-7dd6-424d-bd82-58d9de8bbd92'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:26:47.592832 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Attempting to bind port 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b on network 85f429c8-7dd6-424d-bd82-58d9de8bbd92 {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:26:47.595629 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Allocated IP 172.27.1.168 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/a2a0a8b9-252d-46a7-bbe4-6cda0eb86104) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:26:47.598852 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 26, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:26:47.599527 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Checking segment: {'id': 'e90a3aab-14f8-47af-bc48-1ed099ffa30c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': '85f429c8-7dd6-424d-bd82-58d9de8bbd92'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:26:47.600106 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:47.600677 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Bound using segment: {'id': 'e90a3aab-14f8-47af-bc48-1ed099ffa30c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': '85f429c8-7dd6-424d-bd82-58d9de8bbd92'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:26:47.601379 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Bound port: 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e90a3aab-14f8-47af-bc48-1ed099ffa30c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': '85f429c8-7dd6-424d-bd82-58d9de8bbd92'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:26:47.601955 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:47.683776 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] For port 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:26:47.688406 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] For port 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b,segment=NetworkSegment(e90a3aab-14f8-47af-bc48-1ed099ffa30c),segment_id=e90a3aab-14f8-47af-bc48-1ed099ffa30c)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:26:47.740371 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 47ad1537-84e2-4b23-9edf-269b2ea4d931 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:26:47.784804 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:47.789789 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:47.851705 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 47ad1537-84e2-4b23-9edf-269b2ea4d931 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:47.851705 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:47.887671 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6885eefa-97a9-4584-8049-c1b4db85d979 None None] Pushing event updated for resources: {'Port': ['ID=3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:47.920753 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:47.995258 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:26:48.004562 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:26:48.010091 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:26:48.055127 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Pushing event updated for resources: {'Port': ['ID=a2a0a8b9-252d-46a7-bbe4-6cda0eb86104,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:48.565379 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:48.632356 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eb3335f-0f3c-41bf-8f4c-abcebb099656 req-2ea34d88-315d-4044-ac75-a10c0ab5488a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:48.634804 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4eb3335f-0f3c-41bf-8f4c-abcebb099656 req-2ea34d88-315d-4044-ac75-a10c0ab5488a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.1178095 Nov 11 17:26:48.739867 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-4eb3335f-0f3c-41bf-8f4c-abcebb099656 req-a0e52782-45a8-47bc-a7c3-978706caa189 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0947568 Nov 11 17:26:48.846297 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-424501', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-397235'] for router, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:48.923516 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-357190e8-7621-4231-9793-81325135f310 None None] Network 85f429c8-7dd6-424d-bd82-58d9de8bbd92 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:26:49.060955 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-0e26a928-871f-4074-96c2-2c7df05d4f82 None None] Provisioning complete for port 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:49.061526 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-0e26a928-871f-4074-96c2-2c7df05d4f82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:49.084914 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Router 305cca58-7c3f-4b61-9307-6a6ecb3f20c2 is scheduled to L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 with binding_index 1 {{(pid=102324) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 17:26:49.207315 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:26:49.225185 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Sync routers for ids ['305cca58-7c3f-4b61-9307-6a6ecb3f20c2'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:26:49.301692 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Routers {'305cca58-7c3f-4b61-9307-6a6ecb3f20c2'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:26:49.302342 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:26:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['305cca58-7c3f-4b61-9307-6a6ecb3f20c2'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:26:49.311005 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] Publish callbacks [] for router, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:49.313471 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-a3b6dc4e-b549-4265-b81f-6771dd81fcea admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.8722098 Nov 11 17:26:49.315884 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38128) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:26:49.387248 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-0e26a928-871f-4074-96c2-2c7df05d4f82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:49.546350 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-0e26a928-871f-4074-96c2-2c7df05d4f82 None None] For port 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b,segment=NetworkSegment(e90a3aab-14f8-47af-bc48-1ed099ffa30c),segment_id=e90a3aab-14f8-47af-bc48-1ed099ffa30c)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:26:49.577824 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Set router 305cca58-7c3f-4b61-9307-6a6ecb3f20c2 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:26:49.629122 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-0e26a928-871f-4074-96c2-2c7df05d4f82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:49.754674 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:26:49.805974 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e26a928-871f-4074-96c2-2c7df05d4f82 None None] Pushing event updated for resources: {'Port': ['ID=3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:49.829897 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-a22b0305-dea5-47ce-8671-2250c5786fe1 None None] Provisioning complete for port 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:49.830277 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-a22b0305-dea5-47ce-8671-2250c5786fe1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:49.884081 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5db4023a-c874-40d8-bb9c-5aa8514e85d1 req-9e002d4e-1110-4ca9-b4ad-e24f09f1941c tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:49.886462 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5db4023a-c874-40d8-bb9c-5aa8514e85d1 req-9e002d4e-1110-4ca9-b4ad-e24f09f1941c tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.0528436 Nov 11 17:26:49.895709 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:49.930722 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:49.931286 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:49.953913 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5db4023a-c874-40d8-bb9c-5aa8514e85d1 req-23a195ae-9186-4ab4-9823-05a93b57f164 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0538921 Nov 11 17:26:50.024169 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'name': 'tempest-TestMinimumBasicScenario-1633009201-router', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.168'}], 'enable_snat': True}, 'gw_port_id': 'a2a0a8b9-252d-46a7-bbe4-6cda0eb86104', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:46Z', 'updated_at': '2021-11-11T17:26:48Z', 'revision_number': 3, 'project_id': '3130da64ca90454cbfe95cf315e224fb', 'gw_port': {'id': 'a2a0a8b9-252d-46a7-bbe4-6cda0eb86104', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:bb:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:47Z', 'updated_at': '2021-11-11T17:26:47Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:26:50.055168 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Checking router: 305cca58-7c3f-4b61-9307-6a6ecb3f20c2 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:26:50.055522 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Updating router 305cca58-7c3f-4b61-9307-6a6ecb3f20c2 port a2a0a8b9-252d-46a7-bbe4-6cda0eb86104 binding host dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:26:50.092161 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Allocated IP 172.20.0.1 (85f429c8-7dd6-424d-bd82-58d9de8bbd92/2d507788-8511-49e5-8d1c-7289c3ccf113/efed5ca1-780e-4730-8e9a-766e764411d2) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:26:50.104344 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:50.214459 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:50.303711 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:50.366899 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Network 85f429c8-7dd6-424d-bd82-58d9de8bbd92 is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:26:50.375822 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:26:50.381874 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:26:50.429792 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Pushing event updated for resources: {'Port': ['ID=efed5ca1-780e-4730-8e9a-766e764411d2,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:50.458536 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-394084'] for router_interface, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:50.674858 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Publish callbacks [] for port, precommit_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:50.676582 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-a04c1c81-6d04-4a55-9248-92672cbe55bd None None] Provisioning complete for port efed5ca1-780e-4730-8e9a-766e764411d2 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:50.676939 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-a04c1c81-6d04-4a55-9248-92672cbe55bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:50.678225 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:50.714914 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-a04c1c81-6d04-4a55-9248-92672cbe55bd None None] Port efed5ca1-780e-4730-8e9a-766e764411d2 cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:26:50.771171 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:50.831041 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Attempting to bind port a2a0a8b9-252d-46a7-bbe4-6cda0eb86104 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:26:50.831392 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Attempting to bind port a2a0a8b9-252d-46a7-bbe4-6cda0eb86104 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:26:50.831757 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Attempting to bind port a2a0a8b9-252d-46a7-bbe4-6cda0eb86104 on network 78b17769-6fae-453e-8ae3-4a72e72bccfc {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:26:50.834978 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c584294-0f8b-4dc2-8ae7-858faac9b81a None None] Pushing event updated for resources: {'Port': ['ID=a2a0a8b9-252d-46a7-bbe4-6cda0eb86104,revision_number=2']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:50.840142 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 26, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:26:50.840533 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Checking segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:26:50.840898 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:50.841292 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Bound using segment: {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'} {{(pid=102325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:26:50.841776 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.managers [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Bound port: a2a0a8b9-252d-46a7-bbe4-6cda0eb86104, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7424c811-7de6-42e6-8320-5f665532ffaf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc'}}] {{(pid=102325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:26:50.842154 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:50.857397 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:50.897611 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] For port a2a0a8b9-252d-46a7-bbe4-6cda0eb86104, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:26:50.901325 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] For port a2a0a8b9-252d-46a7-bbe4-6cda0eb86104, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=a2a0a8b9-252d-46a7-bbe4-6cda0eb86104,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:26:50.919094 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:50.994379 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:50.996826 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Pushing event updated for resources: {'Port': ['ID=efed5ca1-780e-4730-8e9a-766e764411d2,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:51.004571 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8103788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-394224'] for router_interface, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:51.071129 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Routers {'305cca58-7c3f-4b61-9307-6a6ecb3f20c2'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:26:51.071789 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:26:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['305cca58-7c3f-4b61-9307-6a6ecb3f20c2'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:26:51.075414 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c584294-0f8b-4dc2-8ae7-858faac9b81a None None] Pushing event updated for resources: {'Port': ['ID=a2a0a8b9-252d-46a7-bbe4-6cda0eb86104,revision_number=3']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:51.156155 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a875a973-5b54-4db9-9f47-4ce9be3dd576 req-9c34e97d-fa5a-4ee3-8d55-df19aa9a405c tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:51.157752 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a875a973-5b54-4db9-9f47-4ce9be3dd576 req-9c34e97d-fa5a-4ee3-8d55-df19aa9a405c tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.1180370 Nov 11 17:26:51.198685 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Network 85f429c8-7dd6-424d-bd82-58d9de8bbd92 is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:26:51.203934 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:26:51.246468 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] Set router 305cca58-7c3f-4b61-9307-6a6ecb3f20c2 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:26:51.268701 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a875a973-5b54-4db9-9f47-4ce9be3dd576 req-ed432207-6df1-446e-befb-28c8174c6175 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0978024 Nov 11 17:26:51.364271 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Router 305cca58-7c3f-4b61-9307-6a6ecb3f20c2 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:26:51.505793 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:26:51.512034 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-bfe4892b-ea31-4bd2-839d-e74bf9464267 admin admin] 10.222.0.16 "PUT /v2.0/routers/305cca58-7c3f-4b61-9307-6a6ecb3f20c2/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1947038 Nov 11 17:26:51.548764 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'name': 'tempest-TestMinimumBasicScenario-1633009201-router', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.168'}], 'enable_snat': True}, 'gw_port_id': 'a2a0a8b9-252d-46a7-bbe4-6cda0eb86104', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:46Z', 'updated_at': '2021-11-11T17:26:50Z', 'revision_number': 4, 'project_id': '3130da64ca90454cbfe95cf315e224fb', 'gw_port': {'id': 'a2a0a8b9-252d-46a7-bbe4-6cda0eb86104', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:bb:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:47Z', 'updated_at': '2021-11-11T17:26:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'efed5ca1-780e-4730-8e9a-766e764411d2', 'name': '', 'network_id': '85f429c8-7dd6-424d-bd82-58d9de8bbd92', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'mac_address': 'fa:16:3e:58:5c:dc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '2d507788-8511-49e5-8d1c-7289c3ccf113', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:49Z', 'updated_at': '2021-11-11T17:26:50Z', 'revision_number': 2, 'project_id': '3130da64ca90454cbfe95cf315e224fb', 'subnets': [{'id': '2d507788-8511-49e5-8d1c-7289c3ccf113', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:26:51.581382 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48891b4f-73b9-40ba-9aa9-0a420e4e900c None None] The sync data for ids ['305cca58-7c3f-4b61-9307-6a6ecb3f20c2'] in dv-cinder-694140-2-iscsi is: [{'id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'name': 'tempest-TestMinimumBasicScenario-1633009201-router', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.168'}], 'enable_snat': True}, 'gw_port_id': 'a2a0a8b9-252d-46a7-bbe4-6cda0eb86104', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:46Z', 'updated_at': '2021-11-11T17:26:50Z', 'revision_number': 4, 'project_id': '3130da64ca90454cbfe95cf315e224fb', 'gw_port': {'id': 'a2a0a8b9-252d-46a7-bbe4-6cda0eb86104', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:bb:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:47Z', 'updated_at': '2021-11-11T17:26:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'efed5ca1-780e-4730-8e9a-766e764411d2', 'name': '', 'network_id': '85f429c8-7dd6-424d-bd82-58d9de8bbd92', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'mac_address': 'fa:16:3e:58:5c:dc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '2d507788-8511-49e5-8d1c-7289c3ccf113', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:49Z', 'updated_at': '2021-11-11T17:26:50Z', 'revision_number': 2, 'project_id': '3130da64ca90454cbfe95cf315e224fb', 'subnets': [{'id': '2d507788-8511-49e5-8d1c-7289c3ccf113', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:26:51.584107 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-cb9acb94-12b1-4aba-a8fa-e4177e7a9e77 None None] Provisioning complete for port efed5ca1-780e-4730-8e9a-766e764411d2 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:51.584478 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-cb9acb94-12b1-4aba-a8fa-e4177e7a9e77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:51.656022 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-cb9acb94-12b1-4aba-a8fa-e4177e7a9e77 None None] Port efed5ca1-780e-4730-8e9a-766e764411d2 cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:26:51.722693 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:26:51.793154 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:51.793861 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:52.470103 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0f3d507-981d-44fa-a1dd-9d6dfc997c86 req-a146fd4c-0840-41d8-b6e0-1740e8023eed tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:52.475203 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b0f3d507-981d-44fa-a1dd-9d6dfc997c86 req-a146fd4c-0840-41d8-b6e0-1740e8023eed tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.0952036 Nov 11 17:26:52.545603 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b0f3d507-981d-44fa-a1dd-9d6dfc997c86 req-a71a25da-81d2-4d45-bbcd-ecc5e86f1754 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0628343 Nov 11 17:26:53.716632 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3f5fb3c-6721-4c4e-9927-c435e6696d31 req-8ad1e268-28f6-4161-80b0-c6a2a085899c tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:53.724706 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f3f5fb3c-6721-4c4e-9927-c435e6696d31 req-8ad1e268-28f6-4161-80b0-c6a2a085899c tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.0747609 Nov 11 17:26:53.756496 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device a2a0a8b9-252d-46a7-bbe4-6cda0eb86104 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:26:53.834893 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f3f5fb3c-6721-4c4e-9927-c435e6696d31 req-a21a4f26-57f0-466f-905b-66d2f8b2bfac tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1091275 Nov 11 17:26:53.854055 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port a2a0a8b9-252d-46a7-bbe4-6cda0eb86104 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:53.857898 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:54.026405 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:54.057180 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] For port a2a0a8b9-252d-46a7-bbe4-6cda0eb86104, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=a2a0a8b9-252d-46a7-bbe4-6cda0eb86104,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:26:54.159395 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:54.233539 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Pushing event updated for resources: {'Port': ['ID=a2a0a8b9-252d-46a7-bbe4-6cda0eb86104,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:54.532967 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c115176-bc78-4121-a75d-1c0dffab25e0 req-8d897c29-a6f3-4e20-8e91-9ad745154d85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:54.535642 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9c115176-bc78-4121-a75d-1c0dffab25e0 req-8d897c29-a6f3-4e20-8e91-9ad745154d85 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=53c4ca7574da4b2a868a39a52a98e620&device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 1099 time: 0.0574365 Nov 11 17:26:54.663987 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c115176-bc78-4121-a75d-1c0dffab25e0 req-5c72055b-71fa-475b-8941-2ed1541f0ea4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:54.665527 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9c115176-bc78-4121-a75d-1c0dffab25e0 req-5c72055b-71fa-475b-8941-2ed1541f0ea4 service neutron] 10.222.0.10 "GET /v2.0/networks?id=e1e04a10-fb62-4a0a-a705-82de35b80b1b HTTP/1.1" status: 200 len: 910 time: 0.1179821 Nov 11 17:26:54.745386 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9c115176-bc78-4121-a75d-1c0dffab25e0 req-87b45dc9-bbd2-4b34-96ea-59c4f3d20366 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 HTTP/1.1" status: 200 len: 1001 time: 0.0653558 Nov 11 17:26:54.859827 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c115176-bc78-4121-a75d-1c0dffab25e0 req-4f80395e-0e7e-402d-a748-cec11ed5aced service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:54.861738 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9c115176-bc78-4121-a75d-1c0dffab25e0 req-4f80395e-0e7e-402d-a748-cec11ed5aced service neutron] 10.222.0.10 "GET /v2.0/subnets?id=45e5a299-340d-4f14-b0eb-66727a394b7c HTTP/1.1" status: 200 len: 848 time: 0.1061175 Nov 11 17:26:54.975301 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c115176-bc78-4121-a75d-1c0dffab25e0 req-d32f13e8-90f3-49a9-afe4-512fcf48689a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:54.978533 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9c115176-bc78-4121-a75d-1c0dffab25e0 req-d32f13e8-90f3-49a9-afe4-512fcf48689a service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=e1e04a10-fb62-4a0a-a705-82de35b80b1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1038342 Nov 11 17:26:55.091259 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4bee6f7-00ff-4b45-abd7-53bc0d77b8dd req-e3cbeecb-0275-4e48-b226-0dd7c336ad81 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:55.095320 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d4bee6f7-00ff-4b45-abd7-53bc0d77b8dd req-e3cbeecb-0275-4e48-b226-0dd7c336ad81 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.1180723 Nov 11 17:26:55.117575 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9c115176-bc78-4121-a75d-1c0dffab25e0 req-ac0b38e2-4e8c-4bcb-b91d-c25288b4eb3c service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1274474 Nov 11 17:26:55.226955 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d4bee6f7-00ff-4b45-abd7-53bc0d77b8dd req-19bc3eed-9607-423a-81b4-911d7f24ff2c tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1102710 Nov 11 17:26:55.245982 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-9c115176-bc78-4121-a75d-1c0dffab25e0 req-2e79222c-e861-4687-82a4-ab78b8ec8ebb service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1168509 Nov 11 17:26:55.488408 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Sync routers for ids ['305cca58-7c3f-4b61-9307-6a6ecb3f20c2'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:26:55.502129 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Routers {'305cca58-7c3f-4b61-9307-6a6ecb3f20c2'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:26:55.502994 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:26:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['305cca58-7c3f-4b61-9307-6a6ecb3f20c2'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:26:55.630716 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Set router 305cca58-7c3f-4b61-9307-6a6ecb3f20c2 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:26:55.763843 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device a2a0a8b9-252d-46a7-bbe4-6cda0eb86104 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:26:55.844257 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port a2a0a8b9-252d-46a7-bbe4-6cda0eb86104 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:55.844909 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:55.940363 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'name': 'tempest-TestMinimumBasicScenario-1633009201-router', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.168'}], 'enable_snat': True}, 'gw_port_id': 'a2a0a8b9-252d-46a7-bbe4-6cda0eb86104', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:46Z', 'updated_at': '2021-11-11T17:26:50Z', 'revision_number': 4, 'project_id': '3130da64ca90454cbfe95cf315e224fb', 'gw_port': {'id': 'a2a0a8b9-252d-46a7-bbe4-6cda0eb86104', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:bb:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:47Z', 'updated_at': '2021-11-11T17:26:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'efed5ca1-780e-4730-8e9a-766e764411d2', 'name': '', 'network_id': '85f429c8-7dd6-424d-bd82-58d9de8bbd92', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'mac_address': 'fa:16:3e:58:5c:dc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '2d507788-8511-49e5-8d1c-7289c3ccf113', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:49Z', 'updated_at': '2021-11-11T17:26:50Z', 'revision_number': 2, 'project_id': '3130da64ca90454cbfe95cf315e224fb', 'subnets': [{'id': '2d507788-8511-49e5-8d1c-7289c3ccf113', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:26:55.973144 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Checking router: 305cca58-7c3f-4b61-9307-6a6ecb3f20c2 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:26:55.996074 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Updating router 305cca58-7c3f-4b61-9307-6a6ecb3f20c2 port efed5ca1-780e-4730-8e9a-766e764411d2 binding host dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 17:26:56.001999 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:56.384171 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Publish callbacks [] for port, precommit_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:56.421603 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a068bcd8-d952-4c2d-8488-73e851bb205f req-7e621ca5-41b3-4e89-9140-66790f278354 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:56.424030 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a068bcd8-d952-4c2d-8488-73e851bb205f req-7e621ca5-41b3-4e89-9140-66790f278354 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.0873287 Nov 11 17:26:56.461582 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:56.511858 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a068bcd8-d952-4c2d-8488-73e851bb205f req-f198f53f-74b3-45ec-a4c9-080a08883fdc tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0800965 Nov 11 17:26:56.542696 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43a6d6be-5fa1-41ba-8d89-9e0ebb056a77 None None] Pushing event updated for resources: {'Port': ['ID=efed5ca1-780e-4730-8e9a-766e764411d2,revision_number=3']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:56.638134 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Attempting to bind port efed5ca1-780e-4730-8e9a-766e764411d2 on host dv-cinder-694140-2-iscsi for vnic_type normal with profile {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:26:56.638923 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Attempting to bind port efed5ca1-780e-4730-8e9a-766e764411d2 by drivers openvswitch,hyperv on host dv-cinder-694140-2-iscsi at level 0 using segments [{'id': 'e90a3aab-14f8-47af-bc48-1ed099ffa30c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': '85f429c8-7dd6-424d-bd82-58d9de8bbd92'}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:26:56.639460 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Attempting to bind port efed5ca1-780e-4730-8e9a-766e764411d2 on network 85f429c8-7dd6-424d-bd82-58d9de8bbd92 {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:26:56.649262 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Checking agent: {'id': '638932bb-f001-4e2f-8520-4d0d94da93f6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-694140-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 5, 37), 'started_at': datetime.datetime(2021, 11, 11, 17, 6, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 26, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-694140-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:26:56.652562 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Checking segment: {'id': 'e90a3aab-14f8-47af-bc48-1ed099ffa30c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': '85f429c8-7dd6-424d-bd82-58d9de8bbd92'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:26:56.652562 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:56.652562 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Bound using segment: {'id': 'e90a3aab-14f8-47af-bc48-1ed099ffa30c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': '85f429c8-7dd6-424d-bd82-58d9de8bbd92'} {{(pid=102326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:26:56.652562 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.managers [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Bound port: efed5ca1-780e-4730-8e9a-766e764411d2, host: dv-cinder-694140-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e90a3aab-14f8-47af-bc48-1ed099ffa30c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': '85f429c8-7dd6-424d-bd82-58d9de8bbd92'}}] {{(pid=102326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:26:56.653596 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:56.777452 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] For port efed5ca1-780e-4730-8e9a-766e764411d2, host dv-cinder-694140-2-iscsi, cleared binding levels {{(pid=102326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:26:56.781695 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.plugins.ml2.db [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] For port efed5ca1-780e-4730-8e9a-766e764411d2, host dv-cinder-694140-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=efed5ca1-780e-4730-8e9a-766e764411d2,segment=NetworkSegment(e90a3aab-14f8-47af-bc48-1ed099ffa30c),segment_id=e90a3aab-14f8-47af-bc48-1ed099ffa30c)] {{(pid=102326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:26:56.840113 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron_lib.callbacks.manager [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:56.840657 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-f7de4ea1-880e-4768-a8b5-8a10f67a0960 None None] Provisioning complete for port efed5ca1-780e-4730-8e9a-766e764411d2 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:56.841437 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-f7de4ea1-880e-4768-a8b5-8a10f67a0960 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:56.906072 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43a6d6be-5fa1-41ba-8d89-9e0ebb056a77 None None] Pushing event updated for resources: {'Port': ['ID=efed5ca1-780e-4730-8e9a-766e764411d2,revision_number=4']} {{(pid=102326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:56.943086 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Routers {'305cca58-7c3f-4b61-9307-6a6ecb3f20c2'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:26:56.943721 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:26:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['305cca58-7c3f-4b61-9307-6a6ecb3f20c2'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:26:57.025600 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-f7de4ea1-880e-4768-a8b5-8a10f67a0960 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:57.098280 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-f7de4ea1-880e-4768-a8b5-8a10f67a0960 None None] For port efed5ca1-780e-4730-8e9a-766e764411d2, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=efed5ca1-780e-4730-8e9a-766e764411d2,segment=NetworkSegment(e90a3aab-14f8-47af-bc48-1ed099ffa30c),segment_id=e90a3aab-14f8-47af-bc48-1ed099ffa30c)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:26:57.187559 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-f7de4ea1-880e-4768-a8b5-8a10f67a0960 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:57.251570 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7de4ea1-880e-4768-a8b5-8a10f67a0960 None None] Pushing event updated for resources: {'Port': ['ID=efed5ca1-780e-4730-8e9a-766e764411d2,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:26:57.301096 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] Set router 305cca58-7c3f-4b61-9307-6a6ecb3f20c2 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:26:57.325427 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-62efb91c-c7d6-4ed7-bea0-bdba9df40832 None None] Provisioning complete for port efed5ca1-780e-4730-8e9a-766e764411d2 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:57.330774 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-62efb91c-c7d6-4ed7-bea0-bdba9df40832 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:57.608680 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'name': 'tempest-TestMinimumBasicScenario-1633009201-router', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.168'}], 'enable_snat': True}, 'gw_port_id': 'a2a0a8b9-252d-46a7-bbe4-6cda0eb86104', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:46Z', 'updated_at': '2021-11-11T17:26:50Z', 'revision_number': 4, 'project_id': '3130da64ca90454cbfe95cf315e224fb', 'gw_port': {'id': 'a2a0a8b9-252d-46a7-bbe4-6cda0eb86104', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:bb:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:47Z', 'updated_at': '2021-11-11T17:26:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'efed5ca1-780e-4730-8e9a-766e764411d2', 'name': '', 'network_id': '85f429c8-7dd6-424d-bd82-58d9de8bbd92', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'mac_address': 'fa:16:3e:58:5c:dc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '2d507788-8511-49e5-8d1c-7289c3ccf113', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:49Z', 'updated_at': '2021-11-11T17:26:56Z', 'revision_number': 4, 'project_id': '3130da64ca90454cbfe95cf315e224fb', 'subnets': [{'id': '2d507788-8511-49e5-8d1c-7289c3ccf113', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:26:57.644711 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77b69e17-7eb3-437b-9535-e8147042a870 None None] The sync data for ids ['305cca58-7c3f-4b61-9307-6a6ecb3f20c2'] in dv-cinder-694140-2-iscsi is: [{'id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'name': 'tempest-TestMinimumBasicScenario-1633009201-router', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.168'}], 'enable_snat': True}, 'gw_port_id': 'a2a0a8b9-252d-46a7-bbe4-6cda0eb86104', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:46Z', 'updated_at': '2021-11-11T17:26:50Z', 'revision_number': 4, 'project_id': '3130da64ca90454cbfe95cf315e224fb', 'gw_port': {'id': 'a2a0a8b9-252d-46a7-bbe4-6cda0eb86104', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:bb:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:47Z', 'updated_at': '2021-11-11T17:26:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': 'efed5ca1-780e-4730-8e9a-766e764411d2', 'name': '', 'network_id': '85f429c8-7dd6-424d-bd82-58d9de8bbd92', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'mac_address': 'fa:16:3e:58:5c:dc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '2d507788-8511-49e5-8d1c-7289c3ccf113', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:49Z', 'updated_at': '2021-11-11T17:26:56Z', 'revision_number': 4, 'project_id': '3130da64ca90454cbfe95cf315e224fb', 'subnets': [{'id': '2d507788-8511-49e5-8d1c-7289c3ccf113', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:26:57.744966 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5974e52b-45fc-417c-ba12-776f37b88bca req-ba7908d6-a54e-40d3-bfb5-de39ac4fe0ba tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:57.754265 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5974e52b-45fc-417c-ba12-776f37b88bca req-ba7908d6-a54e-40d3-bfb5-de39ac4fe0ba tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.1123815 Nov 11 17:26:57.840312 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device efed5ca1-780e-4730-8e9a-766e764411d2 up at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:26:57.841257 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5974e52b-45fc-417c-ba12-776f37b88bca req-f8db4c4b-4461-48ee-a388-d5c36888b4a8 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0856769 Nov 11 17:26:57.968951 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Provisioning complete for port efed5ca1-780e-4730-8e9a-766e764411d2 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:26:57.971868 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:26:59.010700 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d29f56e9-52aa-4a86-9fce-3ada7b3ba911 req-b715e27d-a830-46bb-9e4a-b6781d9a83f3 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:26:59.013460 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d29f56e9-52aa-4a86-9fce-3ada7b3ba911 req-b715e27d-a830-46bb-9e4a-b6781d9a83f3 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.0816972 Nov 11 17:26:59.099080 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d29f56e9-52aa-4a86-9fce-3ada7b3ba911 req-2ce66ba9-aaab-4244-ba54-2d95aba98b4e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0787256 Nov 11 17:26:59.203819 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:26:59.215097 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [req-7ff4387d-9850-4810-8708-2eb771e99e08 req-7b614013-b593-4bb4-bb28-a19629a20fa9 service neutron] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=102323) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 17:26:59.218160 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7ff4387d-9850-4810-8708-2eb771e99e08 req-7b614013-b593-4bb4-bb28-a19629a20fa9 service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0097804 Nov 11 17:27:00.665119 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8828069-b58e-4c43-9c3d-63a4bb1915e2 req-e298700d-bee1-4b4e-9eb5-71634a39f1e4 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:00.676882 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f8828069-b58e-4c43-9c3d-63a4bb1915e2 req-e298700d-bee1-4b4e-9eb5-71634a39f1e4 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.0919769 Nov 11 17:27:00.751111 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f8828069-b58e-4c43-9c3d-63a4bb1915e2 req-cc366e00-a445-4f42-910e-79df3547ed65 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0724638 Nov 11 17:27:00.903710 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f02ace5e-2cb9-43b5-95ab-f092790a0e47 req-f19c84d8-5b89-4cdf-b0c5-27ac37a70426 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.2804713 Nov 11 17:27:00.921245 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [req-f02ace5e-2cb9-43b5-95ab-f092790a0e47 req-d1ed724a-8e3a-478b-ac90-fc4a69d7e40d service neutron] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=102323) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 17:27:00.925720 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-f02ace5e-2cb9-43b5-95ab-f092790a0e47 req-d1ed724a-8e3a-478b-ac90-fc4a69d7e40d service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0105433 Nov 11 17:27:00.993347 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b85f8dfd-25d7-4383-ab3c-e7bf120206b6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:01.483090 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:27:01.670216 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:01.708929 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8a8298b6-d69a-409b-b494-a28f3a458069', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:27:01.712407 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-67cd5d37-0b9c-4a8c-9dcb-4f8b2781a7a5" -d '{"events": [{"server_uuid": "8a8298b6-d69a-409b-b494-a28f3a458069", "name": "network-vif-unplugged", "status": "completed", "tag": "b4e35d20-ba9e-4d75-94f0-d6e6b8972c78"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:27:01.728613 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,segment=NetworkSegment(84e8dda5-3747-4e23-984b-1e3957701cfb),segment_id=84e8dda5-3747-4e23-984b-1e3957701cfb)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:27:01.834801 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:01.953350 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,revision_number=6']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:02.001669 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-491db303-e1e4-4681-87ba-4e6ae3f18cfa req-687c1551-778c-4fd7-90e0-6ba025614457 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:02.011725 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-491db303-e1e4-4681-87ba-4e6ae3f18cfa req-687c1551-778c-4fd7-90e0-6ba025614457 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.1174417 Nov 11 17:27:02.080656 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Thu, 11 Nov 2021 17:27:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-17b1f9b5-c607-40b9-9b6f-859a5b7aaf2b x-openstack-request-id: req-17b1f9b5-c607-40b9-9b6f-859a5b7aaf2b {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:27:02.081250 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8a8298b6-d69a-409b-b494-a28f3a458069", "name": "network-vif-unplugged", "status": "failed", "tag": "b4e35d20-ba9e-4d75-94f0-d6e6b8972c78", "code": 422}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:27:02.081534 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-17b1f9b5-c607-40b9-9b6f-859a5b7aaf2b {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:27:02.082184 dv-cinder-694140-2-iscsi neutron-server[102325]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '8a8298b6-d69a-409b-b494-a28f3a458069', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78', 'code': 422} returned with failed status Nov 11 17:27:02.498360 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-491db303-e1e4-4681-87ba-4e6ae3f18cfa req-4ef3ce84-6666-4f90-8052-6032df029fc0 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4847624 Nov 11 17:27:03.668716 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fa1a6c9-cdc8-4427-bbfb-92967e45aeb7 req-fe487154-5614-4df3-b113-8c03a0a1adf8 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:03.670406 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4fa1a6c9-cdc8-4427-bbfb-92967e45aeb7 req-fe487154-5614-4df3-b113-8c03a0a1adf8 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0692761 Nov 11 17:27:03.690205 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-8a5acce7-6dd3-42e5-92c4-61852a6c041c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:03.747602 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4fa1a6c9-cdc8-4427-bbfb-92967e45aeb7 req-aaeccfd9-1f16-416d-868a-2ade10645413 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0662544 Nov 11 17:27:04.644142 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:04.784647 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02ace5e-2cb9-43b5-95ab-f092790a0e47 req-62cf8470-bb98-4c9a-b8fe-9d9b148afd86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:04.787583 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f02ace5e-2cb9-43b5-95ab-f092790a0e47 req-62cf8470-bb98-4c9a-b8fe-9d9b148afd86 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069&tenant_id=53c4ca7574da4b2a868a39a52a98e620 HTTP/1.1" status: 200 len: 1097 time: 0.0677457 Nov 11 17:27:04.885760 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02ace5e-2cb9-43b5-95ab-f092790a0e47 req-ed3f1ed3-ed5f-486e-aab6-82d2dcb880ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:04.887851 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f02ace5e-2cb9-43b5-95ab-f092790a0e47 req-ed3f1ed3-ed5f-486e-aab6-82d2dcb880ae service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=53c4ca7574da4b2a868a39a52a98e620&device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 1097 time: 0.0585802 Nov 11 17:27:04.937835 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57f859db-9daa-4f0b-a1b2-c2fd7ab4d6b4 req-9ece0191-7499-469f-9db3-df6a4af68e49 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:04.939584 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-57f859db-9daa-4f0b-a1b2-c2fd7ab4d6b4 req-9ece0191-7499-469f-9db3-df6a4af68e49 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0625350 Nov 11 17:27:05.008424 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-57f859db-9daa-4f0b-a1b2-c2fd7ab4d6b4 req-a48f7b99-c350-4e08-8e27-ab022095ff1c tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0558705 Nov 11 17:27:05.041785 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02ace5e-2cb9-43b5-95ab-f092790a0e47 req-52615f14-12f1-413f-829c-537cfeadd65c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:05.044063 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f02ace5e-2cb9-43b5-95ab-f092790a0e47 req-52615f14-12f1-413f-829c-537cfeadd65c service neutron] 10.222.0.10 "GET /v2.0/networks?id=e1e04a10-fb62-4a0a-a705-82de35b80b1b HTTP/1.1" status: 200 len: 910 time: 0.1366110 Nov 11 17:27:05.129248 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f02ace5e-2cb9-43b5-95ab-f092790a0e47 req-41160e03-30ad-4456-aefd-1dc328813b43 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 HTTP/1.1" status: 200 len: 999 time: 0.0738494 Nov 11 17:27:05.194637 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02ace5e-2cb9-43b5-95ab-f092790a0e47 req-04632e52-a003-44aa-ac13-211ab6a36688 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:05.196100 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f02ace5e-2cb9-43b5-95ab-f092790a0e47 req-04632e52-a003-44aa-ac13-211ab6a36688 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=45e5a299-340d-4f14-b0eb-66727a394b7c HTTP/1.1" status: 200 len: 848 time: 0.0558088 Nov 11 17:27:05.258073 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02ace5e-2cb9-43b5-95ab-f092790a0e47 req-c18cc331-d188-4053-8e5e-21b2549dc45b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:05.260532 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f02ace5e-2cb9-43b5-95ab-f092790a0e47 req-c18cc331-d188-4053-8e5e-21b2549dc45b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=e1e04a10-fb62-4a0a-a705-82de35b80b1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0519094 Nov 11 17:27:05.391044 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f02ace5e-2cb9-43b5-95ab-f092790a0e47 req-215be511-ba6f-4609-a174-931c50688ef8 service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1189461 Nov 11 17:27:05.505423 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-276a939c-805b-4977-9782-2b9ba5fa9d98 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:05.507451 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-276a939c-805b-4977-9782-2b9ba5fa9d98 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/networks?id=892c147f-3343-4b08-a9a7-9e968821be86 HTTP/1.1" status: 200 len: 814 time: 0.1315475 Nov 11 17:27:05.518378 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f02ace5e-2cb9-43b5-95ab-f092790a0e47 req-63b7b91b-d375-4fe2-b411-bc3092ed0b8a service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1153202 Nov 11 17:27:05.531405 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-29916a22-887a-43e0-a15e-04a6d0fb3446 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/quotas/0918d6b635a04c89ae9c7253d1a3901f HTTP/1.1" status: 200 len: 375 time: 0.0125344 Nov 11 17:27:05.597264 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b3be80af-803a-4a24-8593-e749f3ca8449 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=0918d6b635a04c89ae9c7253d1a3901f&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0579891 Nov 11 17:27:05.710926 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-a5b4c8d2-9b68-4334-8228-8159f74a0c71 service neutron] 10.222.0.16 "GET /v2.0/networks/892c147f-3343-4b08-a9a7-9e968821be86?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0979645 Nov 11 17:27:05.819612 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-870773b5-222e-48dc-90f1-89b820b668f3 service neutron] 10.222.0.16 "GET /v2.0/networks/892c147f-3343-4b08-a9a7-9e968821be86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1006024 Nov 11 17:27:06.102764 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-2687e050-9615-4746-8c46-5f9d51b8e70f req-46f16cb7-ffe6-4f41-89ad-fde4d42df3b9 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 210 time: 0.0322578 Nov 11 17:27:06.204479 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7801e520-2aa0-42de-b836-f625b2ca32ca req-b9bb8adc-e84f-49ce-85ed-512394eae391 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:06.207106 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7801e520-2aa0-42de-b836-f625b2ca32ca req-b9bb8adc-e84f-49ce-85ed-512394eae391 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0896394 Nov 11 17:27:06.270199 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7801e520-2aa0-42de-b836-f625b2ca32ca req-0108db52-7613-4a80-8db2-847e4a250ce6 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0558829 Nov 11 17:27:06.381369 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:07.038468 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:07.196174 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-15f472ed-96e4-41f2-96e2-4bd577892340 req-cac9e752-db3e-4b15-9ca0-aed179d78651 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 210 time: 0.0291803 Nov 11 17:27:07.409106 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9b77faf-876c-4acb-9493-c7d25a7a930f req-24e87712-233b-43d4-99c3-1f300e28f17d tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:07.410635 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c9b77faf-876c-4acb-9493-c7d25a7a930f req-24e87712-233b-43d4-99c3-1f300e28f17d tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0558686 Nov 11 17:27:07.487853 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c9b77faf-876c-4acb-9493-c7d25a7a930f req-baa41b6d-afdb-407f-a194-317903702da3 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0686300 Nov 11 17:27:08.296345 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a11a8543-3eee-4625-ad21-5b9f0cf2fcc1 req-8168932b-fbde-4c15-8233-3e47af4cc7bd tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 210 time: 0.0275714 Nov 11 17:27:08.621191 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8176a1e4-34a6-4e10-8a5a-a174a4e78373 req-67bea6bf-562b-4f65-8811-541f06c02f67 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:08.622830 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8176a1e4-34a6-4e10-8a5a-a174a4e78373 req-67bea6bf-562b-4f65-8811-541f06c02f67 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0590405 Nov 11 17:27:08.694935 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8176a1e4-34a6-4e10-8a5a-a174a4e78373 req-c2a92c70-33bd-498e-bda2-63028d9caa91 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0655985 Nov 11 17:27:08.747604 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-5a1a0bc5-5da0-425c-aad9-b66a4fd12d9a tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:08.749958 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-5a1a0bc5-5da0-425c-aad9-b66a4fd12d9a tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.10 "GET /v2.0/networks?id=892c147f-3343-4b08-a9a7-9e968821be86 HTTP/1.1" status: 200 len: 814 time: 0.1844201 Nov 11 17:27:08.769884 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-7f34f9cf-6958-448e-9728-f61a9bcb167b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Request body: {'port': {'device_id': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'admin_state_up': True, 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:27:08.976216 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-7f34f9cf-6958-448e-9728-f61a9bcb167b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Made reservation on behalf of 0918d6b635a04c89ae9c7253d1a3901f for: {'port': 1} {{(pid=102324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 17:27:08.982862 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-7f34f9cf-6958-448e-9728-f61a9bcb167b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:09.137414 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-7f34f9cf-6958-448e-9728-f61a9bcb167b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Allocated IP 172.20.0.4 (892c147f-3343-4b08-a9a7-9e968821be86/44d8c516-d4c3-4d4e-81bb-be7d2f3122ab/ece9e9ed-bd66-40e0-b970-a147e4852743) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:27:09.344227 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-7f34f9cf-6958-448e-9728-f61a9bcb167b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:09.403397 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-851a6d9f-f265-4495-b8a0-483c60fecabe req-1ccf78fd-f0f2-441e-a2b1-40c1a33a6266 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 210 time: 0.0323911 Nov 11 17:27:09.480054 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-7f34f9cf-6958-448e-9728-f61a9bcb167b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:09.577179 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f34f9cf-6958-448e-9728-f61a9bcb167b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Pushing event updated for resources: {'Port': ['ID=ece9e9ed-bd66-40e0-b970-a147e4852743,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:09.620264 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-7f34f9cf-6958-448e-9728-f61a9bcb167b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Network 892c147f-3343-4b08-a9a7-9e968821be86 is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:27:09.623840 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-7f34f9cf-6958-448e-9728-f61a9bcb167b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:27:09.629452 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-7f34f9cf-6958-448e-9728-f61a9bcb167b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:27:09.763581 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-7f34f9cf-6958-448e-9728-f61a9bcb167b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:09.764579 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-7f34f9cf-6958-448e-9728-f61a9bcb167b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:09.841205 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-7f34f9cf-6958-448e-9728-f61a9bcb167b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0758202 Nov 11 17:27:09.941098 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d589891-104c-4f0b-bef4-649b83250027 req-46821575-493d-4fec-89a4-1b8f61699912 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:09.943665 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2d589891-104c-4f0b-bef4-649b83250027 req-46821575-493d-4fec-89a4-1b8f61699912 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0811591 Nov 11 17:27:10.060890 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-2d589891-104c-4f0b-bef4-649b83250027 req-52b48da0-e243-478c-a1e5-9dea208f4580 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1034760 Nov 11 17:27:10.115852 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-c1d08083-f425-4165-b027-ffa7127df4b9 None None] Provisioning complete for port ece9e9ed-bd66-40e0-b970-a147e4852743 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:27:10.116753 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c1d08083-f425-4165-b027-ffa7127df4b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:10.179178 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-c1d08083-f425-4165-b027-ffa7127df4b9 None None] Port ece9e9ed-bd66-40e0-b970-a147e4852743 cannot update to ACTIVE because it is not bound. {{(pid=102325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 17:27:10.568019 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75503fb3-4ec9-47e9-886d-77212ad11267 req-edb1fa3a-7407-42cb-980e-dd6e1a941932 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:10.570645 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-75503fb3-4ec9-47e9-886d-77212ad11267 req-edb1fa3a-7407-42cb-980e-dd6e1a941932 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 931 time: 0.0740321 Nov 11 17:27:10.631230 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-75503fb3-4ec9-47e9-886d-77212ad11267 req-5cc85417-9871-43c1-a77a-499d26c24216 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496259 Nov 11 17:27:11.235500 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a042475c-30a4-4156-83eb-252c1bb3aa66 req-2aea0850-b2a2-4597-b491-849b6b916df8 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:11.238365 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a042475c-30a4-4156-83eb-252c1bb3aa66 req-2aea0850-b2a2-4597-b491-849b6b916df8 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0705214 Nov 11 17:27:11.329062 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a042475c-30a4-4156-83eb-252c1bb3aa66 req-fcc578f5-9c7d-462a-806f-62590c4d4813 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0798852 Nov 11 17:27:11.798396 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74fabaca-95f1-4baa-9597-76ec11f61635 req-056b704e-c16f-42ff-a46c-ade525b485c0 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:11.801152 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-74fabaca-95f1-4baa-9597-76ec11f61635 req-056b704e-c16f-42ff-a46c-ade525b485c0 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 931 time: 0.0714293 Nov 11 17:27:11.870641 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-74fabaca-95f1-4baa-9597-76ec11f61635 req-9dd653e7-54b2-4115-aabc-e74d6264a9f0 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619571 Nov 11 17:27:12.482514 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8187d176-705b-4dbd-bc7b-5da14f725a1a req-c81c61ac-ef2f-467b-a83a-c8b293d0f667 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:12.484245 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8187d176-705b-4dbd-bc7b-5da14f725a1a req-c81c61ac-ef2f-467b-a83a-c8b293d0f667 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0728970 Nov 11 17:27:12.555536 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8187d176-705b-4dbd-bc7b-5da14f725a1a req-6851bb63-a894-422d-b4b5-0714e4ee9893 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0595291 Nov 11 17:27:13.036151 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-298d6e9f-85c6-4651-9920-3e7fde759cc3 req-743cd38d-0d48-4413-9b5b-967a09cd8814 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:13.040172 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-298d6e9f-85c6-4651-9920-3e7fde759cc3 req-743cd38d-0d48-4413-9b5b-967a09cd8814 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 931 time: 0.0653093 Nov 11 17:27:13.104860 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-298d6e9f-85c6-4651-9920-3e7fde759cc3 req-643b43cc-b738-46e2-a5b1-7cc9d755423e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557256 Nov 11 17:27:13.739107 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8ff0ecf-2280-4b8c-a233-0ce87a97e556 req-f90e8194-7e84-4c3d-951d-138e1042afc2 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:13.741584 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c8ff0ecf-2280-4b8c-a233-0ce87a97e556 req-f90e8194-7e84-4c3d-951d-138e1042afc2 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0681665 Nov 11 17:27:13.837824 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-c8ff0ecf-2280-4b8c-a233-0ce87a97e556 req-9375fb48-1ddb-4d68-9fdf-2b4ccb18a740 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0870929 Nov 11 17:27:14.286689 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7470435-8540-4af0-bb0c-8edf591a113c req-f9396e82-737d-44b5-b4af-a16a05738a2c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:14.289081 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f7470435-8540-4af0-bb0c-8edf591a113c req-f9396e82-737d-44b5-b4af-a16a05738a2c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 931 time: 0.0781751 Nov 11 17:27:14.375728 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f7470435-8540-4af0-bb0c-8edf591a113c req-048cf7e8-c523-4b96-9e1c-328fe528dc62 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0756419 Nov 11 17:27:15.067821 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d286ede1-8048-4f7b-9385-be0f49832f2a req-95896e3b-d95e-48d4-96e4-c4ab3ddd70f0 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:15.072272 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d286ede1-8048-4f7b-9385-be0f49832f2a req-95896e3b-d95e-48d4-96e4-c4ab3ddd70f0 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.1148767 Nov 11 17:27:15.167309 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d286ede1-8048-4f7b-9385-be0f49832f2a req-b1ba76cc-23e0-45a6-b4f9-c9c4f08f8216 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0805531 Nov 11 17:27:15.603903 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c474745-75a2-46d9-882e-725db6c335da req-6d675325-3b89-40d4-95d7-f9eda976180e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:15.610852 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0c474745-75a2-46d9-882e-725db6c335da req-6d675325-3b89-40d4-95d7-f9eda976180e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 931 time: 0.1205232 Nov 11 17:27:15.708084 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0c474745-75a2-46d9-882e-725db6c335da req-e3213aab-1c91-478b-a82a-38ad101a80f5 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0845475 Nov 11 17:27:16.345688 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb3f1e3-edb1-4193-8b75-d8f14d78396a req-b8ec61bd-b620-4eed-8ff6-91adb29e046c tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:16.351045 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9eb3f1e3-edb1-4193-8b75-d8f14d78396a req-b8ec61bd-b620-4eed-8ff6-91adb29e046c tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0724494 Nov 11 17:27:16.419948 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9eb3f1e3-edb1-4193-8b75-d8f14d78396a req-a64f476f-1c27-4c26-9748-9eb0040b7278 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0659873 Nov 11 17:27:16.902037 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03a4dd58-b162-470d-a163-d5b8bf0850a4 req-f0abed65-688e-4be5-af22-3926be0b295c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:16.903763 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-03a4dd58-b162-470d-a163-d5b8bf0850a4 req-f0abed65-688e-4be5-af22-3926be0b295c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 931 time: 0.0956600 Nov 11 17:27:16.976395 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-03a4dd58-b162-470d-a163-d5b8bf0850a4 req-922ba823-18ee-4ce9-812e-72c3283e033f tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0635145 Nov 11 17:27:17.130502 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:17.610663 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc448eb1-6e7a-4c81-ba13-a51c2a62e091 req-9dd6479e-885e-4518-9b63-967fb9309983 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:17.615128 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-bc448eb1-6e7a-4c81-ba13-a51c2a62e091 req-9dd6479e-885e-4518-9b63-967fb9309983 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0904930 Nov 11 17:27:17.684157 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-bc448eb1-6e7a-4c81-ba13-a51c2a62e091 req-efda9692-4b24-43df-af32-b687ae94d625 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0593584 Nov 11 17:27:18.164675 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bb91c1b-4892-4723-ba29-ede0bfab36ce req-9d9bcbc4-98de-4b4e-b341-de192b6d81f6 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:18.167069 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6bb91c1b-4892-4723-ba29-ede0bfab36ce req-9d9bcbc4-98de-4b4e-b341-de192b6d81f6 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 931 time: 0.0839651 Nov 11 17:27:18.258258 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6bb91c1b-4892-4723-ba29-ede0bfab36ce req-1f41138c-6f9e-4a15-8bbe-48c53002bc38 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0812685 Nov 11 17:27:18.856786 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d31c3488-1e07-4066-99fb-c198608b9849 req-9ba130f4-03a7-4797-8c4c-c087a2c2482d tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:18.859598 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d31c3488-1e07-4066-99fb-c198608b9849 req-9ba130f4-03a7-4797-8c4c-c087a2c2482d tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0770125 Nov 11 17:27:18.926666 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d31c3488-1e07-4066-99fb-c198608b9849 req-30a7cbd7-4f8a-4e16-856b-6df191ec45e9 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0571265 Nov 11 17:27:19.383024 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Request body: {'port': {'device_id': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-69414'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:27:19.453136 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d42b074-5453-44d0-854f-9a7e12574f54 req-11c29290-f9cd-4fbd-b6b6-64871c6940a6 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:19.454977 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8d42b074-5453-44d0-854f-9a7e12574f54 req-11c29290-f9cd-4fbd-b6b6-64871c6940a6 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 931 time: 0.1069820 Nov 11 17:27:19.464880 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:19.562366 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-8d42b074-5453-44d0-854f-9a7e12574f54 req-f136e4fa-4e46-4efc-9403-62b5dee3141c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0969522 Nov 11 17:27:19.882899 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ece9e9ed-bd66-40e0-b970-a147e4852743 {{(pid=102324) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:27:19.891499 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:19.906939 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.provisioning_blocks [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Transition to ACTIVE for port object ece9e9ed-bd66-40e0-b970-a147e4852743 will not be triggered until provisioned by entity L2. {{(pid=102324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 17:27:19.975332 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:20.066527 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Pushing event updated for resources: {'Port': ['ID=ece9e9ed-bd66-40e0-b970-a147e4852743,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:20.095331 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aa1956d-d86a-43f5-9e7d-c17d43938934 req-ed2ecbc4-2221-4465-a85f-88d89611351a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:20.097964 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8aa1956d-d86a-43f5-9e7d-c17d43938934 req-ed2ecbc4-2221-4465-a85f-88d89611351a tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0899050 Nov 11 17:27:20.099235 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:20.099687 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:20.100073 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:20.100485 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:20.100889 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:20.101289 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:20.101681 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:20.102074 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:20.103083 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:20.103479 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:20.103891 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:20.104304 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:20.168460 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Attempting to bind port ece9e9ed-bd66-40e0-b970-a147e4852743 on host hv-cinder-69414 for vnic_type normal with profile {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 17:27:20.168779 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Attempting to bind port ece9e9ed-bd66-40e0-b970-a147e4852743 by drivers openvswitch,hyperv on host hv-cinder-69414 at level 0 using segments [{'id': '228b04b9-98b7-47bd-a901-1be44f34a0f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 534, 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86'}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 17:27:20.169111 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Attempting to bind port ece9e9ed-bd66-40e0-b970-a147e4852743 on network 892c147f-3343-4b08-a9a7-9e968821be86 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:27:20.175049 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Port ece9e9ed-bd66-40e0-b970-a147e4852743 on network 892c147f-3343-4b08-a9a7-9e968821be86 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-69414 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 17:27:20.175049 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Attempting to bind port ece9e9ed-bd66-40e0-b970-a147e4852743 on network 892c147f-3343-4b08-a9a7-9e968821be86 {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 17:27:20.181406 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Checking agent: {'id': '6a1e1ade-78d5-4eeb-aaf0-a04dad4bad20', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-69414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'started_at': datetime.datetime(2021, 11, 11, 17, 12, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 17, 27, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 17:27:20.181799 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Checking segment: {'id': '228b04b9-98b7-47bd-a901-1be44f34a0f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 534, 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 17:27:20.182201 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Bound using segment: {'id': '228b04b9-98b7-47bd-a901-1be44f34a0f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 534, 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86'} {{(pid=102324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 17:27:20.182688 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.managers [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Bound port: ece9e9ed-bd66-40e0-b970-a147e4852743, host: hv-cinder-69414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '228b04b9-98b7-47bd-a901-1be44f34a0f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 534, 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86'}}] {{(pid=102324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 17:27:20.183049 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:20.213109 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8aa1956d-d86a-43f5-9e7d-c17d43938934 req-e7aaf7f6-3629-4388-80a9-f2c867356de3 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0918069 Nov 11 17:27:20.272191 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] For port ece9e9ed-bd66-40e0-b970-a147e4852743, host hv-cinder-69414, cleared binding levels {{(pid=102324) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 17:27:20.276390 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] For port ece9e9ed-bd66-40e0-b970-a147e4852743, host hv-cinder-69414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=ece9e9ed-bd66-40e0-b970-a147e4852743,segment=NetworkSegment(228b04b9-98b7-47bd-a901-1be44f34a0f9),segment_id=228b04b9-98b7-47bd-a901-1be44f34a0f9)] {{(pid=102324) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 17:27:20.397424 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:20.437779 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:20.438391 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:20.439852 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] 10.222.0.10 "PUT /v2.0/ports/ece9e9ed-bd66-40e0-b970-a147e4852743 HTTP/1.1" status: 200 len: 1093 time: 1.0617559 Nov 11 17:27:20.440340 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'tag': 'ece9e9ed-bd66-40e0-b970-a147e4852743'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:27:20.442742 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-63dda231-d089-45d5-9088-1736c36f6d91" -d '{"events": [{"name": "network-changed", "server_uuid": "bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6", "tag": "ece9e9ed-bd66-40e0-b970-a147e4852743"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:27:20.470632 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b603e344-8097-418a-bd65-159646fe3f00 service neutron] Pushing event updated for resources: {'Port': ['ID=ece9e9ed-bd66-40e0-b970-a147e4852743,revision_number=3']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:20.505786 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:27:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-85761ed7-f3fa-4620-a32b-4236fe455646 x-openstack-request-id: req-85761ed7-f3fa-4620-a32b-4236fe455646 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:27:20.506173 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6", "tag": "ece9e9ed-bd66-40e0-b970-a147e4852743", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:27:20.506519 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-85761ed7-f3fa-4620-a32b-4236fe455646 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:27:20.507075 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'tag': 'ece9e9ed-bd66-40e0-b970-a147e4852743', 'status': 'completed', 'code': 200} Nov 11 17:27:20.575094 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63dda231-d089-45d5-9088-1736c36f6d91 req-a5498cb2-b647-4f22-97bb-44c52d4edec5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:20.576671 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-63dda231-d089-45d5-9088-1736c36f6d91 req-a5498cb2-b647-4f22-97bb-44c52d4edec5 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0918d6b635a04c89ae9c7253d1a3901f&device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 1096 time: 0.0473366 Nov 11 17:27:20.712237 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63dda231-d089-45d5-9088-1736c36f6d91 req-7525f67f-b199-4863-80a3-d343589d8797 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:20.714143 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-63dda231-d089-45d5-9088-1736c36f6d91 req-7525f67f-b199-4863-80a3-d343589d8797 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=0918d6b635a04c89ae9c7253d1a3901f&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1293983 Nov 11 17:27:20.717048 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfa25dc7-7a58-4694-95ee-435816d34904 req-ac47a680-944f-4d3f-8219-217364f42fcf tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:20.718665 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-cfa25dc7-7a58-4694-95ee-435816d34904 req-ac47a680-944f-4d3f-8219-217364f42fcf tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 943 time: 0.0577176 Nov 11 17:27:20.774135 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-cfa25dc7-7a58-4694-95ee-435816d34904 req-038fe50b-1675-4df7-9038-a4f8c79ba1dc tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0483975 Nov 11 17:27:20.838412 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63dda231-d089-45d5-9088-1736c36f6d91 req-c5c7a880-3070-4ab6-b3cb-a99d7adf8058 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:20.839982 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-63dda231-d089-45d5-9088-1736c36f6d91 req-c5c7a880-3070-4ab6-b3cb-a99d7adf8058 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1147537 Nov 11 17:27:20.912276 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-320cc727-24d2-4ef1-842a-b7d6c3e2dc38 req-fbb5e8be-19e2-4d92-95fb-14db3e8f4418 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:20.913800 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-320cc727-24d2-4ef1-842a-b7d6c3e2dc38 req-fbb5e8be-19e2-4d92-95fb-14db3e8f4418 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=53c4ca7574da4b2a868a39a52a98e620&device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 1097 time: 0.0483391 Nov 11 17:27:20.929764 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-c29e8479-e933-4dfc-94e4-8339c3e42966 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:20.932009 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-c29e8479-e933-4dfc-94e4-8339c3e42966 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0918d6b635a04c89ae9c7253d1a3901f&device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 1096 time: 0.0449574 Nov 11 17:27:21.002143 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-98541e11-f3ad-4221-bfc2-5703a763b1b7 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ece9e9ed-bd66-40e0-b970-a147e4852743 HTTP/1.1" status: 200 len: 217 time: 0.0514359 Nov 11 17:27:21.052694 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-320cc727-24d2-4ef1-842a-b7d6c3e2dc38 req-4b578058-5dfe-40ce-bc9e-a6f519cb342c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:21.054425 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-320cc727-24d2-4ef1-842a-b7d6c3e2dc38 req-4b578058-5dfe-40ce-bc9e-a6f519cb342c service neutron] 10.222.0.10 "GET /v2.0/networks?id=e1e04a10-fb62-4a0a-a705-82de35b80b1b HTTP/1.1" status: 200 len: 910 time: 0.1038482 Nov 11 17:27:21.064226 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-7b710972-8304-499d-9019-8cdc63aefd18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:21.065866 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-7b710972-8304-499d-9019-8cdc63aefd18 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=44d8c516-d4c3-4d4e-81bb-be7d2f3122ab HTTP/1.1" status: 200 len: 853 time: 0.0525663 Nov 11 17:27:21.123946 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b8fd361f-f481-474d-86cc-c880e3cee4d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:21.125474 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b8fd361f-f481-474d-86cc-c880e3cee4d5 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=892c147f-3343-4b08-a9a7-9e968821be86&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0474365 Nov 11 17:27:21.183920 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-320cc727-24d2-4ef1-842a-b7d6c3e2dc38 req-74a9ad5e-7a75-458b-b1db-7d85875b90b5 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 HTTP/1.1" status: 200 len: 999 time: 0.1178181 Nov 11 17:27:21.234673 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-dda7450c-392e-48f6-9b6f-23c9da884ca2 service neutron] 10.222.0.10 "GET /v2.0/networks/892c147f-3343-4b08-a9a7-9e968821be86?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0977085 Nov 11 17:27:21.263219 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-320cc727-24d2-4ef1-842a-b7d6c3e2dc38 req-6a325b93-3a99-4212-bcde-1594a7ea51cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:21.265562 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-320cc727-24d2-4ef1-842a-b7d6c3e2dc38 req-6a325b93-3a99-4212-bcde-1594a7ea51cf service neutron] 10.222.0.10 "GET /v2.0/subnets?id=45e5a299-340d-4f14-b0eb-66727a394b7c HTTP/1.1" status: 200 len: 848 time: 0.0685942 Nov 11 17:27:21.372831 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-d48299b0-91c7-4741-a1d3-4f3d5fb25c77 req-b32dea37-595c-488e-9860-7d00b6d0befe service neutron] 10.222.0.10 "GET /v2.0/networks/892c147f-3343-4b08-a9a7-9e968821be86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1261358 Nov 11 17:27:21.377650 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-320cc727-24d2-4ef1-842a-b7d6c3e2dc38 req-822af7ed-843d-4f54-a1eb-ce55adaddfbb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:21.379499 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-320cc727-24d2-4ef1-842a-b7d6c3e2dc38 req-822af7ed-843d-4f54-a1eb-ce55adaddfbb service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=e1e04a10-fb62-4a0a-a705-82de35b80b1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1017358 Nov 11 17:27:21.397213 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40cf41ee-8cd3-4c12-bb8b-042d2fc477d2 req-79bb06cd-a56b-4267-8e1c-fb90e985aa76 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:21.399055 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-40cf41ee-8cd3-4c12-bb8b-042d2fc477d2 req-79bb06cd-a56b-4267-8e1c-fb90e985aa76 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 944 time: 0.0790567 Nov 11 17:27:21.514284 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-40cf41ee-8cd3-4c12-bb8b-042d2fc477d2 req-21cc02cf-01f7-41c3-9c35-25478aba8424 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1020913 Nov 11 17:27:21.534227 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-320cc727-24d2-4ef1-842a-b7d6c3e2dc38 req-5b866248-9d40-4b3b-8790-2bac514bdf93 service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1332381 Nov 11 17:27:21.557318 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:27:21.659218 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-320cc727-24d2-4ef1-842a-b7d6c3e2dc38 req-d05df2dc-76a0-4867-9f51-8fb736df9c2e service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1135862 Nov 11 17:27:21.713139 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,segment=NetworkSegment(84e8dda5-3747-4e23-984b-1e3957701cfb),segment_id=84e8dda5-3747-4e23-984b-1e3957701cfb)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:27:21.725867 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78', 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'port_id': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78', 'mac_address': 'fa:16:3e:21:43:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 548, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:27:21.773002 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:21.787900 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:27:21.811055 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,segment=NetworkSegment(84e8dda5-3747-4e23-984b-1e3957701cfb),segment_id=84e8dda5-3747-4e23-984b-1e3957701cfb)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:27:21.883101 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:21.909558 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bab40c2-992a-49ad-b1d7-6c8fd0ab746a req-8d38d5c2-4f09-441b-8aa6-fd78395e531d tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:21.911321 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7bab40c2-992a-49ad-b1d7-6c8fd0ab746a req-8d38d5c2-4f09-441b-8aa6-fd78395e531d tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 943 time: 0.0609815 Nov 11 17:27:21.942432 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,revision_number=7']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:21.968320 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-7bab40c2-992a-49ad-b1d7-6c8fd0ab746a req-a2b8483a-e712-445d-a4e0-0aec8fb15f78 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504315 Nov 11 17:27:22.121784 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['b4e35d20-ba9e-4d75-94f0-d6e6b8972c78'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:27:22.654482 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3abdab8-0dfa-494c-a323-e38bfe56c21e req-c905996d-b8fe-4633-9c9b-736dfafd2c7f tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:22.656245 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f3abdab8-0dfa-494c-a323-e38bfe56c21e req-c905996d-b8fe-4633-9c9b-736dfafd2c7f tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 945 time: 0.0606914 Nov 11 17:27:22.720048 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f3abdab8-0dfa-494c-a323-e38bfe56c21e req-ee62ddfd-eb35-4df6-9d2a-0ce749920ecc tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0520372 Nov 11 17:27:23.101887 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d48162a-05bb-4eab-ab56-55ece767095f req-29ef5395-63aa-4257-ac51-e23753275175 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:23.103747 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9d48162a-05bb-4eab-ab56-55ece767095f req-29ef5395-63aa-4257-ac51-e23753275175 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 943 time: 0.0543599 Nov 11 17:27:23.157393 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9d48162a-05bb-4eab-ab56-55ece767095f req-738b10e8-d5f1-4faf-8ad0-7f647daff05e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467300 Nov 11 17:27:23.578394 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device ece9e9ed-bd66-40e0-b970-a147e4852743 details requested by agent hyperv_hv-cinder-69414 with host hv-cinder-69414 {{(pid=102325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 17:27:23.583006 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:27:23.774721 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.db.resource_extend [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 11 17:27:23.850747 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:27:23.851089 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:23.880369 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5351e0ad-dff3-4689-9172-55f185634603 req-f3f51b8d-5637-4ae3-bbea-372282469310 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:23.882012 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5351e0ad-dff3-4689-9172-55f185634603 req-f3f51b8d-5637-4ae3-bbea-372282469310 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 945 time: 0.0774443 Nov 11 17:27:23.890709 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port ece9e9ed-bd66-40e0-b970-a147e4852743, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=ece9e9ed-bd66-40e0-b970-a147e4852743,segment=NetworkSegment(228b04b9-98b7-47bd-a901-1be44f34a0f9),segment_id=228b04b9-98b7-47bd-a901-1be44f34a0f9)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:27:23.915453 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Returning: {'device': 'ece9e9ed-bd66-40e0-b970-a147e4852743', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'port_id': 'ece9e9ed-bd66-40e0-b970-a147e4852743', 'mac_address': 'fa:16:3e:f4:70:cc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 534, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 17:27:23.941479 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-5351e0ad-dff3-4689-9172-55f185634603 req-89062282-ec45-49e6-80df-a586e43c9761 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0517173 Nov 11 17:27:23.984181 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:24.007685 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:24.017194 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ece9e9ed-bd66-40e0-b970-a147e4852743 {{(pid=102325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 17:27:24.064105 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8a8298b6-d69a-409b-b494-a28f3a458069', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:27:24.066759 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bb4a44a4-505e-4fe6-8467-c1dcbc076e8a" -d '{"events": [{"server_uuid": "8a8298b6-d69a-409b-b494-a28f3a458069", "name": "network-vif-plugged", "status": "completed", "tag": "b4e35d20-ba9e-4d75-94f0-d6e6b8972c78"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:27:24.072047 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port ece9e9ed-bd66-40e0-b970-a147e4852743, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=ece9e9ed-bd66-40e0-b970-a147e4852743,segment=NetworkSegment(228b04b9-98b7-47bd-a901-1be44f34a0f9),segment_id=228b04b9-98b7-47bd-a901-1be44f34a0f9)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:27:24.085317 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,segment=NetworkSegment(84e8dda5-3747-4e23-984b-1e3957701cfb),segment_id=84e8dda5-3747-4e23-984b-1e3957701cfb)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:27:24.117200 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:27:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7c0ecd3-c1e4-4d73-8407-a8dc3687f34d x-openstack-request-id: req-b7c0ecd3-c1e4-4d73-8407-a8dc3687f34d {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:27:24.117625 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8a8298b6-d69a-409b-b494-a28f3a458069", "name": "network-vif-plugged", "status": "completed", "tag": "b4e35d20-ba9e-4d75-94f0-d6e6b8972c78", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:27:24.118003 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-b7c0ecd3-c1e4-4d73-8407-a8dc3687f34d {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:27:24.118603 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8a8298b6-d69a-409b-b494-a28f3a458069', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78', 'code': 200} Nov 11 17:27:24.168353 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:24.200478 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:24.226786 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=ece9e9ed-bd66-40e0-b970-a147e4852743,revision_number=4']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:24.295772 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,revision_number=8']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:24.339812 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcc59951-9292-4441-b541-fa4b9c6f8295 req-04a91949-39b1-4d63-9024-d37bdfacfaf6 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:24.342213 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bcc59951-9292-4441-b541-fa4b9c6f8295 req-04a91949-39b1-4d63-9024-d37bdfacfaf6 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 944 time: 0.0909073 Nov 11 17:27:24.401941 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bcc59951-9292-4441-b541-fa4b9c6f8295 req-f1ab26a3-ddf5-44b2-9614-70caa1425b05 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516469 Nov 11 17:27:24.420163 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['ece9e9ed-bd66-40e0-b970-a147e4852743'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:27:24.462610 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb7add5b-3d4a-40b8-b1fd-15f2946f3881 req-e7bbf43a-5c6f-4194-b79e-51921d40b855 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:24.464209 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-eb7add5b-3d4a-40b8-b1fd-15f2946f3881 req-e7bbf43a-5c6f-4194-b79e-51921d40b855 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 1099 time: 0.0472450 Nov 11 17:27:24.539215 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-eb7add5b-3d4a-40b8-b1fd-15f2946f3881 req-8a69a6a1-2379-47f1-8c26-a3fb1f5dafab service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0620861 Nov 11 17:27:25.077693 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c3a9d73-8bc4-4923-814f-fde0b22e0e31 req-26fa1c15-7d33-4df3-98ec-8a755cf2ef08 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:25.079351 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4c3a9d73-8bc4-4923-814f-fde0b22e0e31 req-26fa1c15-7d33-4df3-98ec-8a755cf2ef08 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.0540693 Nov 11 17:27:25.172120 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4c3a9d73-8bc4-4923-814f-fde0b22e0e31 req-464feee8-5af8-4219-9a7a-20b32216b2a1 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0803959 Nov 11 17:27:25.545113 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9bf3b1-37fb-40a8-bde2-9dc3517e068e req-bdf633f0-58cb-43b2-97d5-6fce4d1d6bdc tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:25.546842 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3a9bf3b1-37fb-40a8-bde2-9dc3517e068e req-bdf633f0-58cb-43b2-97d5-6fce4d1d6bdc tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 944 time: 0.0574253 Nov 11 17:27:25.591379 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device ece9e9ed-bd66-40e0-b970-a147e4852743 up at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 17:27:25.608801 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3a9bf3b1-37fb-40a8-bde2-9dc3517e068e req-cb698491-ee0e-4bbb-b30f-0d67083687ae tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513384 Nov 11 17:27:25.757117 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning for port ece9e9ed-bd66-40e0-b970-a147e4852743 completed by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 17:27:25.763179 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Provisioning complete for port ece9e9ed-bd66-40e0-b970-a147e4852743 triggered by entity L2. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:27:25.763645 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:25.853410 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:25.899645 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] For port ece9e9ed-bd66-40e0-b970-a147e4852743, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=ece9e9ed-bd66-40e0-b970-a147e4852743,segment=NetworkSegment(228b04b9-98b7-47bd-a901-1be44f34a0f9),segment_id=228b04b9-98b7-47bd-a901-1be44f34a0f9)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:27:25.985653 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660'] for port, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:26.062076 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Pushing event updated for resources: {'Port': ['ID=ece9e9ed-bd66-40e0-b970-a147e4852743,revision_number=5']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:26.120227 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ece9e9ed-bd66-40e0-b970-a147e4852743'}] {{(pid=102325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:27:26.122761 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a3274be69cedf73f7d24d46bf2e0be05a8622b565a56dfceee8568dd93993dd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-725160f3-4295-499b-b5d1-b240300bba16" -d '{"events": [{"server_uuid": "bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6", "name": "network-vif-plugged", "status": "completed", "tag": "ece9e9ed-bd66-40e0-b970-a147e4852743"}]}' {{(pid=102325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:27:26.162284 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:27:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6ab81db6-1319-44af-a56c-79b1807fc5a9 x-openstack-request-id: req-6ab81db6-1319-44af-a56c-79b1807fc5a9 {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:27:26.162682 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6", "name": "network-vif-plugged", "status": "completed", "tag": "ece9e9ed-bd66-40e0-b970-a147e4852743", "code": 200}]} {{(pid=102325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:27:26.162990 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-6ab81db6-1319-44af-a56c-79b1807fc5a9 {{(pid=102325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:27:26.163431 dv-cinder-694140-2-iscsi neutron-server[102325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ece9e9ed-bd66-40e0-b970-a147e4852743', 'code': 200} Nov 11 17:27:26.334807 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2125ee8-33e8-487f-a5b5-6610372023f4 req-0b41494a-6f8c-4351-9897-fa13ed292546 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:26.336911 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a2125ee8-33e8-487f-a5b5-6610372023f4 req-0b41494a-6f8c-4351-9897-fa13ed292546 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.0806820 Nov 11 17:27:26.397614 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a2125ee8-33e8-487f-a5b5-6610372023f4 req-70398d9f-b398-4c9f-8870-ea21cfd273da tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0530632 Nov 11 17:27:26.518726 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3168974a-f2ba-44ed-9636-0c4448746ff7 req-d693c992-f820-47fa-ba95-d5d4f4dfe690 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:26.520229 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3168974a-f2ba-44ed-9636-0c4448746ff7 req-d693c992-f820-47fa-ba95-d5d4f4dfe690 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 1098 time: 0.0496254 Nov 11 17:27:26.571338 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3168974a-f2ba-44ed-9636-0c4448746ff7 req-70a0d257-6bff-4528-9173-5fc20ed5d41d service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431554 Nov 11 17:27:26.734904 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a20155a-e9f4-4623-be8f-d1c9a4500fbb req-2420f1bd-0862-4ee7-9d17-13b82bafc4bb tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:26.736498 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5a20155a-e9f4-4623-be8f-d1c9a4500fbb req-2420f1bd-0862-4ee7-9d17-13b82bafc4bb tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 945 time: 0.0530176 Nov 11 17:27:26.795857 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-5a20155a-e9f4-4623-be8f-d1c9a4500fbb req-8ee43e99-0c88-49e2-8c23-46d23a4485e9 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529232 Nov 11 17:27:27.934248 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3232ede2-c7ab-4f49-b826-67e6638a4703 req-ee2a8072-3aa2-43b1-90ca-13beee93781b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:27.935836 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3232ede2-c7ab-4f49-b826-67e6638a4703 req-ee2a8072-3aa2-43b1-90ca-13beee93781b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 945 time: 0.0555470 Nov 11 17:27:27.990268 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-3232ede2-c7ab-4f49-b826-67e6638a4703 req-5d813dc5-f7ed-467a-89aa-df01cd3b3a6d tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478821 Nov 11 17:27:28.139700 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e9a6a5-00fc-4f2a-ba63-2294a20f33c8 req-4bebde9b-544d-42f2-bd7e-39cd0c4aa202 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:28.141343 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-78e9a6a5-00fc-4f2a-ba63-2294a20f33c8 req-4bebde9b-544d-42f2-bd7e-39cd0c4aa202 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 945 time: 0.0642338 Nov 11 17:27:28.221581 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-78e9a6a5-00fc-4f2a-ba63-2294a20f33c8 req-1de4d21f-6d77-4328-8533-dc0b53eb64fe tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0731189 Nov 11 17:27:28.597601 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-566c2121-c313-4d1a-88a3-cb74f50f258f req-598cae01-1835-4e6c-8f48-b0d824a488ed tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:28.600372 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-566c2121-c313-4d1a-88a3-cb74f50f258f req-598cae01-1835-4e6c-8f48-b0d824a488ed tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 945 time: 0.0844870 Nov 11 17:27:28.656351 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-566c2121-c313-4d1a-88a3-cb74f50f258f req-1b81b4e3-56fe-4c40-998e-51470cdf784d tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490801 Nov 11 17:27:31.020653 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-27e4f05d-d156-45db-90be-17866966120f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:33.510803 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4c7ea959-4f90-4b3d-b2ca-3800b9d1265e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:34.625124 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:36.203619 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:27:36.419979 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:37.019182 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:39.406331 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50da1ac2-00fa-453f-88ff-28501e48f88b req-cca6e49e-4ddc-470d-a6f2-e13fda039465 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:39.407862 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-50da1ac2-00fa-453f-88ff-28501e48f88b req-cca6e49e-4ddc-470d-a6f2-e13fda039465 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 945 time: 0.0631492 Nov 11 17:27:39.469930 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-50da1ac2-00fa-453f-88ff-28501e48f88b req-a007b88c-373a-4255-a5d4-5359c6620811 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517404 Nov 11 17:27:39.496104 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38404) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:27:39.586959 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75687a6b-f4cb-4171-a4bd-efbbbb36e4a3 tempest-TestMinimumBasicScenario-571244626 tempest-TestMinimumBasicScenario-571244626-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:39.588482 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-75687a6b-f4cb-4171-a4bd-efbbbb36e4a3 tempest-TestMinimumBasicScenario-571244626 tempest-TestMinimumBasicScenario-571244626-project-admin] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 1093 time: 0.0913649 Nov 11 17:27:39.591935 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38408) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:27:39.596344 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Request body: {'floatingip': {'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'port_id': 'ece9e9ed-bd66-40e0-b970-a147e4852743', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'fixed_ip_address': '172.20.0.4'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:27:39.713137 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for floatingip, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:39.865260 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:39.983859 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.db_base_plugin_common [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Allocated IP 172.27.1.36 (78b17769-6fae-453e-8ae3-4a72e72bccfc/85627140-b558-482a-a384-b2095063cd88/16896aaf-7ae6-42ef-8c4f-8331c06582dd) {{(pid=102324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 17:27:40.158076 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for port, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:40.242490 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8735338080624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:40.282607 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Network 78b17769-6fae-453e-8ae3-4a72e72bccfc is already hosted by enough agents. {{(pid=102324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 17:27:40.288124 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.base_scheduler [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Resources bound (agent type, host, resource id): {{(pid=102324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 17:27:40.292175 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Received port after_create {{(pid=102324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 17:27:40.322455 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Pushing event updated for resources: {'Port': ['ID=16896aaf-7ae6-42ef-8c4f-8331c06582dd,revision_number=1']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:40.702906 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:40.861749 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:41.063271 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:41.173184 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:41.254579 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Pushing event updated for resources: {'Port': ['ID=16896aaf-7ae6-42ef-8c4f-8331c06582dd,revision_number=2']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:41.273941 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-397293'] for floatingip, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:41.400555 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.l3_db [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Floating IP df948f4d-ebe8-4b3c-b924-b23d8129aa29 associated. External IP: 172.27.1.36, port: ece9e9ed-bd66-40e0-b970-a147e4852743. Nov 11 17:27:41.641968 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Router 0f921ab3-c03d-4722-9f80-7301a23dc466 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:27:41.763138 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:27:41.775554 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29baa305-1f2e-4a44-98bf-ae2f8da60d85 None None] Sync routers for ids ['0f921ab3-c03d-4722-9f80-7301a23dc466'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:27:41.787872 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29baa305-1f2e-4a44-98bf-ae2f8da60d85 None None] Routers {'0f921ab3-c03d-4722-9f80-7301a23dc466'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:27:41.790364 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-29baa305-1f2e-4a44-98bf-ae2f8da60d85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:27:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['0f921ab3-c03d-4722-9f80-7301a23dc466'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:27:41.849808 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:41.925675 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-29baa305-1f2e-4a44-98bf-ae2f8da60d85 None None] Set router 0f921ab3-c03d-4722-9f80-7301a23dc466 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:27:42.187874 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-84028e56-ffc6-4f2e-b4a9-72c9cc042dee tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.5947442 Nov 11 17:27:42.188357 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'tag': 'ece9e9ed-bd66-40e0-b970-a147e4852743'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:27:42.190723 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dcb6e68d-7b67-4c8f-b894-e88df0438729" -d '{"events": [{"name": "network-changed", "server_uuid": "bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6", "tag": "ece9e9ed-bd66-40e0-b970-a147e4852743"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:27:42.191957 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38410) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:27:42.200764 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1722152956', 'description': 'tempest-secgroup-smoke-1722152956 description', 'project_id': '0918d6b635a04c89ae9c7253d1a3901f'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:27:42.235434 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-29baa305-1f2e-4a44-98bf-ae2f8da60d85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'name': 'tempest-TestMinimumBasicScenario-910390135-router', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:38Z', 'updated_at': '2021-11-11T17:26:42Z', 'revision_number': 4, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'gw_port': {'id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:7a:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:39Z', 'updated_at': '2021-11-11T17:26:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': 'df948f4d-ebe8-4b3c-b924-b23d8129aa29', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'floating_ip_address': '172.27.1.36', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'port_id': 'ece9e9ed-bd66-40e0-b970-a147e4852743', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 693, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'mac_address': 'fa:16:3e:f4:70:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:27:40Z', 'updated_at': '2021-11-11T17:27:40Z', 'revision_number': 0, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '47ad1537-84e2-4b23-9edf-269b2ea4d931', 'name': '', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'mac_address': 'fa:16:3e:a2:83:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:41Z', 'updated_at': '2021-11-11T17:26:46Z', 'revision_number': 5, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'subnets': [{'id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:27:42.261400 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:27:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ebf34d57-9e26-4890-af0b-da08ab807388 x-openstack-request-id: req-ebf34d57-9e26-4890-af0b-da08ab807388 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:27:42.261882 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6", "tag": "ece9e9ed-bd66-40e0-b970-a147e4852743", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:27:42.262282 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-ebf34d57-9e26-4890-af0b-da08ab807388 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:27:42.263052 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'tag': 'ece9e9ed-bd66-40e0-b970-a147e4852743', 'status': 'completed', 'code': 200} Nov 11 17:27:42.264147 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29baa305-1f2e-4a44-98bf-ae2f8da60d85 None None] Checking router: 0f921ab3-c03d-4722-9f80-7301a23dc466 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:27:42.273977 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29baa305-1f2e-4a44-98bf-ae2f8da60d85 None None] Routers {'0f921ab3-c03d-4722-9f80-7301a23dc466'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:27:42.274771 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-29baa305-1f2e-4a44-98bf-ae2f8da60d85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:27:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['0f921ab3-c03d-4722-9f80-7301a23dc466'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:27:42.321557 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:42.360955 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcb6e68d-7b67-4c8f-b894-e88df0438729 req-6998ea46-8e20-4c28-b04b-0f86c1c89154 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:42.363470 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dcb6e68d-7b67-4c8f-b894-e88df0438729 req-6998ea46-8e20-4c28-b04b-0f86c1c89154 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0918d6b635a04c89ae9c7253d1a3901f&device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 1098 time: 0.0731127 Nov 11 17:27:42.439545 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:42.446669 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-29baa305-1f2e-4a44-98bf-ae2f8da60d85 None None] Set router 0f921ab3-c03d-4722-9f80-7301a23dc466 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:27:42.521610 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:42.527113 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcb6e68d-7b67-4c8f-b894-e88df0438729 req-8544c45d-f2fa-49ff-95b5-ef97efae5423 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:42.528618 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dcb6e68d-7b67-4c8f-b894-e88df0438729 req-8544c45d-f2fa-49ff-95b5-ef97efae5423 service neutron] 10.222.0.10 "GET /v2.0/networks?id=892c147f-3343-4b08-a9a7-9e968821be86 HTTP/1.1" status: 200 len: 915 time: 0.1565280 Nov 11 17:27:42.583709 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Pushing event updated for resources: {'SecurityGroup': ['ID=16b573d5-d5bb-418e-a88c-5b3305ec7b17,revision_number=1']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:42.596194 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:42.596770 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:42.597216 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:42.597694 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:42.599008 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:42.599008 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:42.599405 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:42.599833 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:42.600347 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:42.600853 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:42.601309 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:42.601743 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:27:42.628976 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dcb6e68d-7b67-4c8f-b894-e88df0438729 req-dcd82716-b81c-48a9-9780-8c69c70ff200 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ece9e9ed-bd66-40e0-b970-a147e4852743 HTTP/1.1" status: 200 len: 998 time: 0.0923898 Nov 11 17:27:42.649561 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:42.652175 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-0ad33244-bcc6-4d93-af20-a009860cac9e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.4568038 Nov 11 17:27:42.667808 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38414) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:27:42.674619 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-7505f280-f147-4c70-9476-1b0144a36745 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Request body: {'security_group_rule': {'security_group_id': '16b573d5-d5bb-418e-a88c-5b3305ec7b17', 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:27:42.695436 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcb6e68d-7b67-4c8f-b894-e88df0438729 req-0eea8ff4-986e-44ab-b787-0851867d1e6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:42.695436 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dcb6e68d-7b67-4c8f-b894-e88df0438729 req-0eea8ff4-986e-44ab-b787-0851867d1e6e service neutron] 10.222.0.10 "GET /v2.0/subnets?id=44d8c516-d4c3-4d4e-81bb-be7d2f3122ab HTTP/1.1" status: 200 len: 853 time: 0.0561047 Nov 11 17:27:42.757663 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7505f280-f147-4c70-9476-1b0144a36745 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:42.781505 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcb6e68d-7b67-4c8f-b894-e88df0438729 req-b7585107-e053-4d84-a0ad-5ad0adcb8f9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:42.785853 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dcb6e68d-7b67-4c8f-b894-e88df0438729 req-b7585107-e053-4d84-a0ad-5ad0adcb8f9a service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=892c147f-3343-4b08-a9a7-9e968821be86&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0825450 Nov 11 17:27:42.816765 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-29baa305-1f2e-4a44-98bf-ae2f8da60d85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'name': 'tempest-TestMinimumBasicScenario-910390135-router', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:38Z', 'updated_at': '2021-11-11T17:26:42Z', 'revision_number': 4, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'gw_port': {'id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:7a:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:39Z', 'updated_at': '2021-11-11T17:26:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': 'df948f4d-ebe8-4b3c-b924-b23d8129aa29', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'floating_ip_address': '172.27.1.36', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'port_id': 'ece9e9ed-bd66-40e0-b970-a147e4852743', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 693, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'mac_address': 'fa:16:3e:f4:70:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:27:40Z', 'updated_at': '2021-11-11T17:27:40Z', 'revision_number': 0, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '47ad1537-84e2-4b23-9edf-269b2ea4d931', 'name': '', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'mac_address': 'fa:16:3e:a2:83:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:41Z', 'updated_at': '2021-11-11T17:26:46Z', 'revision_number': 5, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'subnets': [{'id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:27:42.849836 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29baa305-1f2e-4a44-98bf-ae2f8da60d85 None None] The sync data for ids ['0f921ab3-c03d-4722-9f80-7301a23dc466'] in dv-cinder-694140-2-iscsi is: [{'id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'name': 'tempest-TestMinimumBasicScenario-910390135-router', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:38Z', 'updated_at': '2021-11-11T17:26:42Z', 'revision_number': 4, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'gw_port': {'id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:7a:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:39Z', 'updated_at': '2021-11-11T17:26:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_floatingips': [{'id': 'df948f4d-ebe8-4b3c-b924-b23d8129aa29', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'floating_ip_address': '172.27.1.36', 'floating_network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'router_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'port_id': 'ece9e9ed-bd66-40e0-b970-a147e4852743', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 693, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'mac_address': 'fa:16:3e:f4:70:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T17:27:40Z', 'updated_at': '2021-11-11T17:27:40Z', 'revision_number': 0, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '47ad1537-84e2-4b23-9edf-269b2ea4d931', 'name': '', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'mac_address': 'fa:16:3e:a2:83:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:41Z', 'updated_at': '2021-11-11T17:26:46Z', 'revision_number': 5, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'subnets': [{'id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:27:42.855208 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7505f280-f147-4c70-9476-1b0144a36745 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:42.916123 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7505f280-f147-4c70-9476-1b0144a36745 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:42.934934 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dcb6e68d-7b67-4c8f-b894-e88df0438729 req-82992f8f-cfea-4770-bb3d-f140e5a28751 service neutron] 10.222.0.10 "GET /v2.0/networks/892c147f-3343-4b08-a9a7-9e968821be86?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1417572 Nov 11 17:27:42.953174 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7505f280-f147-4c70-9476-1b0144a36745 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7289c020-c76f-4752-bd2b-b4d28f88fe0a,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:43.032008 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-7505f280-f147-4c70-9476-1b0144a36745 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:43.033325 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-7505f280-f147-4c70-9476-1b0144a36745 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3642683 Nov 11 17:27:43.039001 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38416) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:27:43.047689 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [None req-682b8f52-fcc0-44fd-9a05-77cb39ee0cd6 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Request body: {'security_group_rule': {'security_group_id': '16b573d5-d5bb-418e-a88c-5b3305ec7b17', 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:27:43.074253 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-dcb6e68d-7b67-4c8f-b894-e88df0438729 req-3973d275-2fd6-448d-9f4e-1e485d4f17f4 service neutron] 10.222.0.10 "GET /v2.0/networks/892c147f-3343-4b08-a9a7-9e968821be86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1230509 Nov 11 17:27:43.117650 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd4aae96-1fd1-4163-9618-6b402b105d45 None None] New status for floating IP df948f4d-ebe8-4b3c-b924-b23d8129aa29: ACTIVE {{(pid=102326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:27:43.174197 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-682b8f52-fcc0-44fd-9a05-77cb39ee0cd6 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:43.267947 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-682b8f52-fcc0-44fd-9a05-77cb39ee0cd6 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:43.338972 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-682b8f52-fcc0-44fd-9a05-77cb39ee0cd6 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:43.361766 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-682b8f52-fcc0-44fd-9a05-77cb39ee0cd6 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2ccb8b57-2e05-43de-99fd-6cd462dfe947,revision_number=0']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:43.443519 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-682b8f52-fcc0-44fd-9a05-77cb39ee0cd6 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:43.445784 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-682b8f52-fcc0-44fd-9a05-77cb39ee0cd6 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4053292 Nov 11 17:27:43.450280 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38418) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:27:43.455621 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-f627ad1f-eaf2-4e84-b9af-583d580084cc tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Request body: {'security_group_rule': {'security_group_id': '16b573d5-d5bb-418e-a88c-5b3305ec7b17', 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:27:43.550260 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f627ad1f-eaf2-4e84-b9af-583d580084cc tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:43.629750 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f627ad1f-eaf2-4e84-b9af-583d580084cc tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:43.709913 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f627ad1f-eaf2-4e84-b9af-583d580084cc tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:43.732946 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f627ad1f-eaf2-4e84-b9af-583d580084cc tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f4b75a60-4bfe-4c4c-afde-6d3d19ddc4a7,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:43.780528 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f627ad1f-eaf2-4e84-b9af-583d580084cc tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:43.781851 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-f627ad1f-eaf2-4e84-b9af-583d580084cc tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3304374 Nov 11 17:27:43.786381 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38420) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:27:43.791176 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-597be092-fc99-42d7-b1db-f03866488924 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Request body: {'security_group_rule': {'security_group_id': '16b573d5-d5bb-418e-a88c-5b3305ec7b17', 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:27:43.881191 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-597be092-fc99-42d7-b1db-f03866488924 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:43.952301 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-597be092-fc99-42d7-b1db-f03866488924 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:44.018873 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-597be092-fc99-42d7-b1db-f03866488924 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:44.037927 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-597be092-fc99-42d7-b1db-f03866488924 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6c72fc67-e791-410e-b55d-c70b03042aa4,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:44.109098 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-597be092-fc99-42d7-b1db-f03866488924 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:44.111119 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-597be092-fc99-42d7-b1db-f03866488924 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3236501 Nov 11 17:27:44.114110 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38422) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:27:44.120010 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-7063fc58-404d-4ffd-adc1-94fdc98be3c7 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Request body: {'security_group_rule': {'security_group_id': '16b573d5-d5bb-418e-a88c-5b3305ec7b17', 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:27:44.201845 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.securitygroups_db [None req-7063fc58-404d-4ffd-adc1-94fdc98be3c7 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Project 0918d6b635a04c89ae9c7253d1a3901f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 17:27:44.208473 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7063fc58-404d-4ffd-adc1-94fdc98be3c7 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:44.277083 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7063fc58-404d-4ffd-adc1-94fdc98be3c7 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:44.355771 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7063fc58-404d-4ffd-adc1-94fdc98be3c7 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:44.377449 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7063fc58-404d-4ffd-adc1-94fdc98be3c7 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4ba63d68-f0e3-4298-9f6c-3b403774e6fe,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:44.455193 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-7063fc58-404d-4ffd-adc1-94fdc98be3c7 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:44.456380 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-7063fc58-404d-4ffd-adc1-94fdc98be3c7 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3408444 Nov 11 17:27:44.459519 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38424) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:27:44.465081 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [None req-c61c1031-726d-4172-912a-87def535f37c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Request body: {'security_group_rule': {'security_group_id': '16b573d5-d5bb-418e-a88c-5b3305ec7b17', 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:27:44.549838 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.db.securitygroups_db [None req-c61c1031-726d-4172-912a-87def535f37c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Project 0918d6b635a04c89ae9c7253d1a3901f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 17:27:44.556167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c61c1031-726d-4172-912a-87def535f37c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:44.628182 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c61c1031-726d-4172-912a-87def535f37c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:44.732983 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c61c1031-726d-4172-912a-87def535f37c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865734'] for security_group_rule, after_create {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:44.750529 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c61c1031-726d-4172-912a-87def535f37c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a71817dc-7710-40e2-a135-09f611ebf80f,revision_number=0']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:44.832141 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-c61c1031-726d-4172-912a-87def535f37c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:44.833428 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-c61c1031-726d-4172-912a-87def535f37c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3728819 Nov 11 17:27:44.961008 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b4553457-2362-4d10-896c-5bc492354217 req-d48d6cb8-5859-4c45-926c-f85bc2effdcc tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1722152956&fields=id&tenant_id=0918d6b635a04c89ae9c7253d1a3901f HTTP/1.1" status: 200 len: 267 time: 0.0696466 Nov 11 17:27:45.314446 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4553457-2362-4d10-896c-5bc492354217 req-8ce62d2f-69dc-4392-b5fa-551ed72bb0e1 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:45.316066 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b4553457-2362-4d10-896c-5bc492354217 req-8ce62d2f-69dc-4392-b5fa-551ed72bb0e1 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 945 time: 0.3492539 Nov 11 17:27:45.328020 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.v2.base [req-b4553457-2362-4d10-896c-5bc492354217 req-a23540a5-6d53-4412-a1f5-2ca52f6f1099 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Request body: {'port': {'security_groups': ['a6f2f987-e7b7-4ed2-ae1e-736f35635781', '16b573d5-d5bb-418e-a88c-5b3305ec7b17']}} {{(pid=102323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:27:45.395217 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-b4553457-2362-4d10-896c-5bc492354217 req-a23540a5-6d53-4412-a1f5-2ca52f6f1099 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:45.631645 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [req-b4553457-2362-4d10-896c-5bc492354217 req-a23540a5-6d53-4412-a1f5-2ca52f6f1099 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] For port ece9e9ed-bd66-40e0-b970-a147e4852743, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=ece9e9ed-bd66-40e0-b970-a147e4852743,segment=NetworkSegment(228b04b9-98b7-47bd-a901-1be44f34a0f9),segment_id=228b04b9-98b7-47bd-a901-1be44f34a0f9)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:27:45.676320 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-b4553457-2362-4d10-896c-5bc492354217 req-a23540a5-6d53-4412-a1f5-2ca52f6f1099 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for port, precommit_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:45.760728 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-b4553457-2362-4d10-896c-5bc492354217 req-a23540a5-6d53-4412-a1f5-2ca52f6f1099 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5720697'] for port, after_update {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:45.774574 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['ece9e9ed-bd66-40e0-b970-a147e4852743'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:27:45.815687 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4553457-2362-4d10-896c-5bc492354217 req-a23540a5-6d53-4412-a1f5-2ca52f6f1099 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:45.816370 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [req-b4553457-2362-4d10-896c-5bc492354217 req-a23540a5-6d53-4412-a1f5-2ca52f6f1099 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:45.821653 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-b4553457-2362-4d10-896c-5bc492354217 req-a23540a5-6d53-4412-a1f5-2ca52f6f1099 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "PUT /v2.0/ports/ece9e9ed-bd66-40e0-b970-a147e4852743 HTTP/1.1" status: 200 len: 981 time: 0.4984200 Nov 11 17:27:45.822173 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'tag': 'ece9e9ed-bd66-40e0-b970-a147e4852743'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:27:45.824734 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a1b61af-a6b3-4954-a0a7-58c079508e1e" -d '{"events": [{"name": "network-changed", "server_uuid": "bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6", "tag": "ece9e9ed-bd66-40e0-b970-a147e4852743"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:27:45.879034 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a23540a5-6d53-4412-a1f5-2ca52f6f1099 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Pushing event updated for resources: {'Port': ['ID=ece9e9ed-bd66-40e0-b970-a147e4852743,revision_number=6']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:27:45.925149 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['ece9e9ed-bd66-40e0-b970-a147e4852743'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:27:45.961637 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:27:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0e5fd76d-f4ea-4571-9f70-402a5b8fb52c x-openstack-request-id: req-0e5fd76d-f4ea-4571-9f70-402a5b8fb52c {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:27:45.962298 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6", "tag": "ece9e9ed-bd66-40e0-b970-a147e4852743", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:27:45.962298 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-0e5fd76d-f4ea-4571-9f70-402a5b8fb52c {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:27:45.962688 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'tag': 'ece9e9ed-bd66-40e0-b970-a147e4852743', 'status': 'completed', 'code': 200} Nov 11 17:27:45.964755 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c41e6e93-9f6c-4dc5-86cc-0c257946aa97 req-a68e515c-c41b-45ad-99df-546d89ae60a6 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:45.971265 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c41e6e93-9f6c-4dc5-86cc-0c257946aa97 req-a68e515c-c41b-45ad-99df-546d89ae60a6 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 984 time: 0.0765092 Nov 11 17:27:46.083435 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c41e6e93-9f6c-4dc5-86cc-0c257946aa97 req-3f7bbcff-3d29-4010-94f0-7d6fbe8a809e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&id=16b573d5-d5bb-418e-a88c-5b3305ec7b17&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1037412 Nov 11 17:27:46.087681 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a1b61af-a6b3-4954-a0a7-58c079508e1e req-4c9c2c68-3936-46ac-a8dd-30fa8fbf33ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:46.089347 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6a1b61af-a6b3-4954-a0a7-58c079508e1e req-4c9c2c68-3936-46ac-a8dd-30fa8fbf33ca service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0918d6b635a04c89ae9c7253d1a3901f&device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 1137 time: 0.0912313 Nov 11 17:27:46.211158 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a1b61af-a6b3-4954-a0a7-58c079508e1e req-68f8e9ab-a313-492e-9f1d-d83bec69273d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:46.213147 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6a1b61af-a6b3-4954-a0a7-58c079508e1e req-68f8e9ab-a313-492e-9f1d-d83bec69273d service neutron] 10.222.0.10 "GET /v2.0/networks?id=892c147f-3343-4b08-a9a7-9e968821be86 HTTP/1.1" status: 200 len: 915 time: 0.1155784 Nov 11 17:27:46.226359 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-8443086f-358e-4af8-a769-9987ab22e967 None None] Provisioning complete for port ece9e9ed-bd66-40e0-b970-a147e4852743 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:27:46.227025 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-8443086f-358e-4af8-a769-9987ab22e967 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:27:46.294159 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6a1b61af-a6b3-4954-a0a7-58c079508e1e req-1a61f7dc-e35c-4861-800f-3d549c123824 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ece9e9ed-bd66-40e0-b970-a147e4852743 HTTP/1.1" status: 200 len: 1000 time: 0.0726991 Nov 11 17:27:46.350093 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a1b61af-a6b3-4954-a0a7-58c079508e1e req-61ae53ef-cb8d-4c74-aadb-1e8e2a3b6034 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:46.351660 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6a1b61af-a6b3-4954-a0a7-58c079508e1e req-61ae53ef-cb8d-4c74-aadb-1e8e2a3b6034 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=44d8c516-d4c3-4d4e-81bb-be7d2f3122ab HTTP/1.1" status: 200 len: 853 time: 0.0493093 Nov 11 17:27:46.409887 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a1b61af-a6b3-4954-a0a7-58c079508e1e req-4ca03822-d612-408d-b5ae-25206d2a15e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:27:46.411579 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6a1b61af-a6b3-4954-a0a7-58c079508e1e req-4ca03822-d612-408d-b5ae-25206d2a15e5 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=892c147f-3343-4b08-a9a7-9e968821be86&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0485699 Nov 11 17:27:46.533734 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6a1b61af-a6b3-4954-a0a7-58c079508e1e req-e295bffb-a271-4017-8b5d-1432a3cbefc6 service neutron] 10.222.0.10 "GET /v2.0/networks/892c147f-3343-4b08-a9a7-9e968821be86?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1115644 Nov 11 17:27:46.642283 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-6a1b61af-a6b3-4954-a0a7-58c079508e1e req-1477a9b5-75fe-443f-bc39-06fe893d1cc9 service neutron] 10.222.0.10 "GET /v2.0/networks/892c147f-3343-4b08-a9a7-9e968821be86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0993679 Nov 11 17:27:47.034219 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:00.949321 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-aa065df7-9f52-452b-b0b6-efdd7b75a6cf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:03.513865 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcf3d167-6e3f-4ec2-b7a9-c6a6fa4a3543 req-9339c354-d7c0-4546-8133-1c00e3bca6dd tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:03.515513 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bcf3d167-6e3f-4ec2-b7a9-c6a6fa4a3543 req-9339c354-d7c0-4546-8133-1c00e3bca6dd tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 984 time: 0.0705295 Nov 11 17:28:03.526635 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-cd6fe5de-df1c-48cb-ac9c-df008a10a43a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:03.580923 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b52ef537-70f9-455e-a04f-7de63dac327c req-7ecc69f6-c630-412f-b9e0-94558657841e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:03.582474 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b52ef537-70f9-455e-a04f-7de63dac327c req-7ecc69f6-c630-412f-b9e0-94558657841e service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0918d6b635a04c89ae9c7253d1a3901f&device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 1137 time: 0.0891721 Nov 11 17:28:03.624295 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-bcf3d167-6e3f-4ec2-b7a9-c6a6fa4a3543 req-82a7b4b5-2cb5-4552-a893-744281a1416a tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&id=16b573d5-d5bb-418e-a88c-5b3305ec7b17&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0941818 Nov 11 17:28:03.738097 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b52ef537-70f9-455e-a04f-7de63dac327c req-8fe2519d-3ae4-451a-87f5-6d2715174762 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:03.741559 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b52ef537-70f9-455e-a04f-7de63dac327c req-8fe2519d-3ae4-451a-87f5-6d2715174762 service neutron] 10.222.0.10 "GET /v2.0/networks?id=892c147f-3343-4b08-a9a7-9e968821be86 HTTP/1.1" status: 200 len: 915 time: 0.1457074 Nov 11 17:28:03.820337 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b52ef537-70f9-455e-a04f-7de63dac327c req-2e398014-f3a9-4220-bc22-fc28aed4a474 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ece9e9ed-bd66-40e0-b970-a147e4852743 HTTP/1.1" status: 200 len: 1000 time: 0.0712643 Nov 11 17:28:03.876196 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b52ef537-70f9-455e-a04f-7de63dac327c req-6a9edc9f-97df-40f0-9aee-e1035ddbe2b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:03.877845 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b52ef537-70f9-455e-a04f-7de63dac327c req-6a9edc9f-97df-40f0-9aee-e1035ddbe2b7 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=44d8c516-d4c3-4d4e-81bb-be7d2f3122ab HTTP/1.1" status: 200 len: 853 time: 0.0497196 Nov 11 17:28:03.937854 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b52ef537-70f9-455e-a04f-7de63dac327c req-c885dd16-184a-4d54-b185-0e519ee94ae2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:03.940540 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b52ef537-70f9-455e-a04f-7de63dac327c req-c885dd16-184a-4d54-b185-0e519ee94ae2 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=892c147f-3343-4b08-a9a7-9e968821be86&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0540242 Nov 11 17:28:04.048356 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b52ef537-70f9-455e-a04f-7de63dac327c req-8a720e7a-7b4e-4cbc-8a01-368129fb6e25 service neutron] 10.222.0.10 "GET /v2.0/networks/892c147f-3343-4b08-a9a7-9e968821be86?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0984218 Nov 11 17:28:04.179099 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-b52ef537-70f9-455e-a04f-7de63dac327c req-f2e0e995-cc44-4f24-a345-4fcdf0817ef7 service neutron] 10.222.0.10 "GET /v2.0/networks/892c147f-3343-4b08-a9a7-9e968821be86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1162243 Nov 11 17:28:04.672294 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:04.764994 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082b4a56-afb0-41e7-ad44-6ac086edeb6b req-403a9171-c304-420d-8e18-7448ea991261 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:04.766782 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-082b4a56-afb0-41e7-ad44-6ac086edeb6b req-403a9171-c304-420d-8e18-7448ea991261 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 984 time: 0.0563223 Nov 11 17:28:04.834507 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-082b4a56-afb0-41e7-ad44-6ac086edeb6b req-0c7da2c3-27a2-4cd8-a55f-721e1845ea6b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&id=16b573d5-d5bb-418e-a88c-5b3305ec7b17&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0596926 Nov 11 17:28:05.961958 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-684cdaaf-6c71-4e1a-9ad1-94ce4dc85847 req-550e05ca-658f-44ec-89fd-f32388b7ec1c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:05.963544 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-684cdaaf-6c71-4e1a-9ad1-94ce4dc85847 req-550e05ca-658f-44ec-89fd-f32388b7ec1c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 984 time: 0.0557654 Nov 11 17:28:06.037583 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-684cdaaf-6c71-4e1a-9ad1-94ce4dc85847 req-ef10cebc-6199-40a4-a01e-e8ba49be6cdf tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&id=16b573d5-d5bb-418e-a88c-5b3305ec7b17&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0671473 Nov 11 17:28:06.429364 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:07.005459 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:07.194780 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c3aeab1-c8af-4dbe-a434-541c9542e1e2 req-9fe46e66-0ad8-4046-8d1f-4bace0bb5d1c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:07.196976 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8c3aeab1-c8af-4dbe-a434-541c9542e1e2 req-9fe46e66-0ad8-4046-8d1f-4bace0bb5d1c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 984 time: 0.0721481 Nov 11 17:28:07.269994 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-8c3aeab1-c8af-4dbe-a434-541c9542e1e2 req-3652eafb-f0a1-4d8c-933b-70a3fdf0270b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&id=16b573d5-d5bb-418e-a88c-5b3305ec7b17&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0661552 Nov 11 17:28:08.403232 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e4c3ea4-a18b-4bf5-87ac-3b76f97f9664 req-98df2dfe-733a-4029-8908-ed74ddb5a472 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:08.404946 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0e4c3ea4-a18b-4bf5-87ac-3b76f97f9664 req-98df2dfe-733a-4029-8908-ed74ddb5a472 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 984 time: 0.0591807 Nov 11 17:28:08.473748 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0e4c3ea4-a18b-4bf5-87ac-3b76f97f9664 req-66419dfc-b3bf-4190-bb88-c9376bcb6a7c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&id=16b573d5-d5bb-418e-a88c-5b3305ec7b17&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0620177 Nov 11 17:28:09.605169 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d761cb0-49a2-4813-9226-47582cf04f41 req-73d89976-cc67-4ee1-848e-010398cbd9d5 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:09.606808 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4d761cb0-49a2-4813-9226-47582cf04f41 req-73d89976-cc67-4ee1-848e-010398cbd9d5 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 984 time: 0.0580359 Nov 11 17:28:09.681272 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-4d761cb0-49a2-4813-9226-47582cf04f41 req-aac84b38-158f-4cfb-8acf-6e7e6afc9ac3 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&id=16b573d5-d5bb-418e-a88c-5b3305ec7b17&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0629089 Nov 11 17:28:10.827366 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6cf9716-13c9-4080-8f0c-2847695cd6f3 req-91458d8a-28b5-4ac3-b572-26d46e0a4eef tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:10.829952 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d6cf9716-13c9-4080-8f0c-2847695cd6f3 req-91458d8a-28b5-4ac3-b572-26d46e0a4eef tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 984 time: 0.0559647 Nov 11 17:28:10.909847 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-d6cf9716-13c9-4080-8f0c-2847695cd6f3 req-52e7b3a3-af4a-4e70-830e-7e6d72b71c1f tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&id=16b573d5-d5bb-418e-a88c-5b3305ec7b17&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0728335 Nov 11 17:28:12.034380 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be1b25dc-f6ad-4e77-a1ff-8939ff1e4514 req-ba9cca11-979b-4b42-b11d-d041eb857ecd tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:12.043145 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-be1b25dc-f6ad-4e77-a1ff-8939ff1e4514 req-ba9cca11-979b-4b42-b11d-d041eb857ecd tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 984 time: 0.0525689 Nov 11 17:28:12.107735 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-be1b25dc-f6ad-4e77-a1ff-8939ff1e4514 req-ddf38dc9-12b0-4b67-b2b2-6a0869f20704 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&id=16b573d5-d5bb-418e-a88c-5b3305ec7b17&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0640335 Nov 11 17:28:13.207943 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:28:13.250150 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac40e6d9-b612-474b-8651-e28605fcf0e8 req-efebe5a7-8bae-4ca0-8684-22bbd4c80242 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:13.252998 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac40e6d9-b612-474b-8651-e28605fcf0e8 req-efebe5a7-8bae-4ca0-8684-22bbd4c80242 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 984 time: 0.0630403 Nov 11 17:28:13.340535 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-ac40e6d9-b612-474b-8651-e28605fcf0e8 req-dc8ef2af-73c8-438a-91af-c47119e281c6 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&id=16b573d5-d5bb-418e-a88c-5b3305ec7b17&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0800962 Nov 11 17:28:14.488890 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f6f3905-7848-46cb-b21a-01b10a0934b4 req-eb92546a-7bd6-434d-9ca5-ad6abcf04573 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:14.490628 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9f6f3905-7848-46cb-b21a-01b10a0934b4 req-eb92546a-7bd6-434d-9ca5-ad6abcf04573 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 984 time: 0.0540648 Nov 11 17:28:14.566238 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-9f6f3905-7848-46cb-b21a-01b10a0934b4 req-225494de-8696-493c-94c9-94284818415b tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&id=16b573d5-d5bb-418e-a88c-5b3305ec7b17&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0689285 Nov 11 17:28:15.703496 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d92a4a0-77ca-4578-b8e1-4145839b15ff req-907f026b-2181-4fea-a57b-94bd4d3a4370 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:15.705101 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0d92a4a0-77ca-4578-b8e1-4145839b15ff req-907f026b-2181-4fea-a57b-94bd4d3a4370 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 984 time: 0.0556240 Nov 11 17:28:15.776653 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-0d92a4a0-77ca-4578-b8e1-4145839b15ff req-9883a56e-c25d-4d97-901d-899f797018ce tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&id=16b573d5-d5bb-418e-a88c-5b3305ec7b17&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0643554 Nov 11 17:28:16.965803 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:20.855659 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f95982c3-a3a0-4032-a078-08ea0ef11225 req-c45024b7-da78-4c0c-ad12-a728edfb0279 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0441375 Nov 11 17:28:20.946207 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f95982c3-a3a0-4032-a078-08ea0ef11225 req-abe3f4d3-0ceb-42de-9178-ecff7e1cc880 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:20.947896 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f95982c3-a3a0-4032-a078-08ea0ef11225 req-abe3f4d3-0ceb-42de-9178-ecff7e1cc880 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=53c4ca7574da4b2a868a39a52a98e620&device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 1099 time: 0.0454447 Nov 11 17:28:21.072643 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f95982c3-a3a0-4032-a078-08ea0ef11225 req-a02d6300-1c52-44d2-baca-025a76e73384 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:21.074353 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f95982c3-a3a0-4032-a078-08ea0ef11225 req-a02d6300-1c52-44d2-baca-025a76e73384 service neutron] 10.222.0.10 "GET /v2.0/networks?id=e1e04a10-fb62-4a0a-a705-82de35b80b1b HTTP/1.1" status: 200 len: 910 time: 0.1060011 Nov 11 17:28:21.151851 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f95982c3-a3a0-4032-a078-08ea0ef11225 req-ed3fdf2d-efd8-4f2e-94c9-8987a5a3dec7 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 HTTP/1.1" status: 200 len: 1001 time: 0.0696387 Nov 11 17:28:21.208984 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f95982c3-a3a0-4032-a078-08ea0ef11225 req-56914385-5eca-4a70-8693-1881660636a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:21.210642 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f95982c3-a3a0-4032-a078-08ea0ef11225 req-56914385-5eca-4a70-8693-1881660636a8 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=45e5a299-340d-4f14-b0eb-66727a394b7c HTTP/1.1" status: 200 len: 848 time: 0.0500133 Nov 11 17:28:21.260674 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f95982c3-a3a0-4032-a078-08ea0ef11225 req-1051aff7-19e3-43b3-9408-1d96da96ef30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:21.262218 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f95982c3-a3a0-4032-a078-08ea0ef11225 req-1051aff7-19e3-43b3-9408-1d96da96ef30 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=e1e04a10-fb62-4a0a-a705-82de35b80b1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0448923 Nov 11 17:28:21.426995 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f95982c3-a3a0-4032-a078-08ea0ef11225 req-e4e8ac64-3090-408a-813d-e45a204a4d40 service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1565998 Nov 11 17:28:21.528728 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f95982c3-a3a0-4032-a078-08ea0ef11225 req-a12b0455-40e3-4a09-82fe-8b1f8c1abd8b service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0951624 Nov 11 17:28:30.945822 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c90c4c0c-ef56-4c58-b1d6-a6a5682b0774 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:33.522257 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ec43e073-845d-46ad-8a84-2e20c0b1ed66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:34.620126 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:36.357196 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:37.014249 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:44.741852 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38484) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:28:44.916369 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Deleting port ea18439d-ded5-4767-aad7-7ff789497d69 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:28:44.916875 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:45.002877 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:45.003238 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:45.018106 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Calling delete_port for ea18439d-ded5-4767-aad7-7ff789497d69 owned by network:floatingip {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:28:45.318437 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:45.349922 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Pushing event deleted for resources: {'Port': ['ID=ea18439d-ded5-4767-aad7-7ff789497d69,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:28:45.375613 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:45.375968 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:45.376313 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:45.376647 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:45.376978 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:45.377304 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:45.377634 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:45.377956 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:45.378278 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:45.378630 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:45.378958 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:45.379283 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:45.423947 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for floatingip, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:45.424274 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.l3_db [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Floating IP 0968eb4b-d847-4921-93c1-df53213dead5 disassociated (deleted). External IP: 172.27.1.80, port: b4e35d20-ba9e-4d75-94f0-d6e6b8972c78. Nov 11 17:28:45.657729 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Router fbdb60a9-d48f-44d5-a652-95278f391d51 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:28:45.782992 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:28:45.788952 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:45.799824 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b182bb63-0683-4645-95b4-3569d785aa77 None None] Sync routers for ids ['fbdb60a9-d48f-44d5-a652-95278f391d51'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:28:45.819287 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b182bb63-0683-4645-95b4-3569d785aa77 None None] Routers {'fbdb60a9-d48f-44d5-a652-95278f391d51'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:28:45.822231 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-b182bb63-0683-4645-95b4-3569d785aa77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:28:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['fbdb60a9-d48f-44d5-a652-95278f391d51'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:45.822404 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-84358bde-43dc-4b2c-a6ad-d588990f574e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "DELETE /v2.0/floatingips/0968eb4b-d847-4921-93c1-df53213dead5 HTTP/1.1" status: 204 len: 168 time: 1.0779257 Nov 11 17:28:45.822404 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8a8298b6-d69a-409b-b494-a28f3a458069', 'tag': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:28:45.826335 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f8c50d02-c6e0-4747-bb5f-72c7770ec053" -d '{"events": [{"name": "network-changed", "server_uuid": "8a8298b6-d69a-409b-b494-a28f3a458069", "tag": "b4e35d20-ba9e-4d75-94f0-d6e6b8972c78"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:28:45.865654 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:28:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bc30aa84-71cf-4205-999d-ad9aee84a7a3 x-openstack-request-id: req-bc30aa84-71cf-4205-999d-ad9aee84a7a3 {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:28:45.865941 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8a8298b6-d69a-409b-b494-a28f3a458069", "tag": "b4e35d20-ba9e-4d75-94f0-d6e6b8972c78", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:28:45.866189 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-bc30aa84-71cf-4205-999d-ad9aee84a7a3 {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:28:45.866621 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8a8298b6-d69a-409b-b494-a28f3a458069', 'tag': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78', 'status': 'completed', 'code': 200} Nov 11 17:28:45.967757 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8c50d02-c6e0-4747-bb5f-72c7770ec053 req-37593e2a-ac61-451a-8300-cae0977be599 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:45.970319 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f8c50d02-c6e0-4747-bb5f-72c7770ec053 req-37593e2a-ac61-451a-8300-cae0977be599 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=53c4ca7574da4b2a868a39a52a98e620&device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 1099 time: 0.0704644 Nov 11 17:28:45.982230 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-b182bb63-0683-4645-95b4-3569d785aa77 None None] Set router fbdb60a9-d48f-44d5-a652-95278f391d51 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:28:46.108380 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8c50d02-c6e0-4747-bb5f-72c7770ec053 req-0b7f468d-417c-4499-a5fd-be5a0a5d1ead service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:46.110602 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f8c50d02-c6e0-4747-bb5f-72c7770ec053 req-0b7f468d-417c-4499-a5fd-be5a0a5d1ead service neutron] 10.222.0.10 "GET /v2.0/networks?id=e1e04a10-fb62-4a0a-a705-82de35b80b1b HTTP/1.1" status: 200 len: 910 time: 0.1310353 Nov 11 17:28:46.163960 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f8c50d02-c6e0-4747-bb5f-72c7770ec053 req-0e667dfa-9742-4f97-93fc-565be68b5b4c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 HTTP/1.1" status: 200 len: 217 time: 0.0399566 Nov 11 17:28:46.250278 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8c50d02-c6e0-4747-bb5f-72c7770ec053 req-3b981b8d-cdcf-4045-93d2-2ddc3045a844 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:46.251597 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f8c50d02-c6e0-4747-bb5f-72c7770ec053 req-3b981b8d-cdcf-4045-93d2-2ddc3045a844 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=45e5a299-340d-4f14-b0eb-66727a394b7c HTTP/1.1" status: 200 len: 848 time: 0.0796533 Nov 11 17:28:46.260933 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-b182bb63-0683-4645-95b4-3569d785aa77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'name': 'tempest-TestShelveInstance-1336680617-router', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13'}], 'enable_snat': True}, 'gw_port_id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:47Z', 'updated_at': '2021-11-11T17:23:52Z', 'revision_number': 4, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'gw_port': {'id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:48:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:48Z', 'updated_at': '2021-11-11T17:23:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '27767633-1ab7-44d5-890c-4a3c38c807f6', 'name': '', 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'mac_address': 'fa:16:3e:6a:e7:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:51Z', 'updated_at': '2021-11-11T17:23:55Z', 'revision_number': 5, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'subnets': [{'id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:46.294738 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b182bb63-0683-4645-95b4-3569d785aa77 None None] Checking router: fbdb60a9-d48f-44d5-a652-95278f391d51 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:28:46.305104 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b182bb63-0683-4645-95b4-3569d785aa77 None None] Routers {'fbdb60a9-d48f-44d5-a652-95278f391d51'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:28:46.305741 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-b182bb63-0683-4645-95b4-3569d785aa77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:28:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['fbdb60a9-d48f-44d5-a652-95278f391d51'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:46.320360 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8c50d02-c6e0-4747-bb5f-72c7770ec053 req-a921a6bf-8878-4c72-b86e-1de6b0842e3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:46.321976 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f8c50d02-c6e0-4747-bb5f-72c7770ec053 req-a921a6bf-8878-4c72-b86e-1de6b0842e3c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=e1e04a10-fb62-4a0a-a705-82de35b80b1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0622187 Nov 11 17:28:46.434770 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-b182bb63-0683-4645-95b4-3569d785aa77 None None] Set router fbdb60a9-d48f-44d5-a652-95278f391d51 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:28:46.464619 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f8c50d02-c6e0-4747-bb5f-72c7770ec053 req-1230bb16-2277-4684-adce-5e91496594fc service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1326602 Nov 11 17:28:46.542254 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a15e1cdf-2f61-4179-ad92-4d541763da90 req-d5c0bc6f-55f1-4c03-a7db-8e4f4a78df02 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:46.544890 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a15e1cdf-2f61-4179-ad92-4d541763da90 req-d5c0bc6f-55f1-4c03-a7db-8e4f4a78df02 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.1333053 Nov 11 17:28:46.676570 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-b182bb63-0683-4645-95b4-3569d785aa77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'name': 'tempest-TestShelveInstance-1336680617-router', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13'}], 'enable_snat': True}, 'gw_port_id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:47Z', 'updated_at': '2021-11-11T17:23:52Z', 'revision_number': 4, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'gw_port': {'id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:48:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:48Z', 'updated_at': '2021-11-11T17:23:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '27767633-1ab7-44d5-890c-4a3c38c807f6', 'name': '', 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'mac_address': 'fa:16:3e:6a:e7:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:51Z', 'updated_at': '2021-11-11T17:23:55Z', 'revision_number': 5, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'subnets': [{'id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:46.687944 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-a15e1cdf-2f61-4179-ad92-4d541763da90 req-de6fc1b1-89e8-426c-a7ce-4a6498b9c9e9 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1310983 Nov 11 17:28:46.711527 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-f8c50d02-c6e0-4747-bb5f-72c7770ec053 req-83b6ed46-38ac-441c-81e7-cd1b73804126 service neutron] 10.222.0.10 "GET /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2366419 Nov 11 17:28:46.711916 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b182bb63-0683-4645-95b4-3569d785aa77 None None] The sync data for ids ['fbdb60a9-d48f-44d5-a652-95278f391d51'] in dv-cinder-694140-2-iscsi is: [{'id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'name': 'tempest-TestShelveInstance-1336680617-router', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13'}], 'enable_snat': True}, 'gw_port_id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:47Z', 'updated_at': '2021-11-11T17:23:52Z', 'revision_number': 4, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'gw_port': {'id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:48:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:48Z', 'updated_at': '2021-11-11T17:23:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '27767633-1ab7-44d5-890c-4a3c38c807f6', 'name': '', 'network_id': 'e1e04a10-fb62-4a0a-a705-82de35b80b1b', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'mac_address': 'fa:16:3e:6a:e7:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:51Z', 'updated_at': '2021-11-11T17:23:55Z', 'revision_number': 5, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'subnets': [{'id': '45e5a299-340d-4f14-b0eb-66727a394b7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:28:46.978963 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7e42377-7327-44ca-ab8a-e146ed77e8e6 None None] New status for floating IP 0968eb4b-d847-4921-93c1-df53213dead5: DOWN {{(pid=102326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:28:46.998187 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:47.827403 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa4a922b-3e2f-4243-ab82-37d61a2b4f50 req-140353c5-9be6-4ee4-b211-1fc097a19af7 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:47.829027 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fa4a922b-3e2f-4243-ab82-37d61a2b4f50 req-140353c5-9be6-4ee4-b211-1fc097a19af7 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.0550733 Nov 11 17:28:47.885705 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-fa4a922b-3e2f-4243-ab82-37d61a2b4f50 req-1ef8e2c9-55b7-43c9-a284-55dc1449bf79 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/security-groups?id=b9ce3bfe-8c24-4f72-add6-2af585f671b3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0502448 Nov 11 17:28:48.120722 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-598b57fa-8a03-43a9-83ca-29e053b5566c req-b5011252-c98e-40b7-861a-46ffa840298b tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:48.122309 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-598b57fa-8a03-43a9-83ca-29e053b5566c req-b5011252-c98e-40b7-861a-46ffa840298b tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.10 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 946 time: 0.0549753 Nov 11 17:28:48.236096 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-598b57fa-8a03-43a9-83ca-29e053b5566c req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Deleting port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:28:48.236653 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-598b57fa-8a03-43a9-83ca-29e053b5566c req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:48.369607 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-598b57fa-8a03-43a9-83ca-29e053b5566c req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] For port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,segment=NetworkSegment(84e8dda5-3747-4e23-984b-1e3957701cfb),segment_id=84e8dda5-3747-4e23-984b-1e3957701cfb)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:28:48.369988 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-598b57fa-8a03-43a9-83ca-29e053b5566c req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:48.386666 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-598b57fa-8a03-43a9-83ca-29e053b5566c req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Calling delete_port for b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 owned by compute:nova {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:28:48.512536 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-58b824aa-300a-45e8-af6c-54d49b9ec7a3 req-22748c9d-654e-4b1e-b99a-240a50fd0876 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1722152956&fields=id&tenant_id=0918d6b635a04c89ae9c7253d1a3901f HTTP/1.1" status: 200 len: 267 time: 0.0793245 Nov 11 17:28:48.617256 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58b824aa-300a-45e8-af6c-54d49b9ec7a3 req-fd09f6e5-f569-4cd6-ba03-5002dc9c6309 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:48.619004 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-58b824aa-300a-45e8-af6c-54d49b9ec7a3 req-fd09f6e5-f569-4cd6-ba03-5002dc9c6309 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 984 time: 0.0983675 Nov 11 17:28:48.635443 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.v2.base [req-58b824aa-300a-45e8-af6c-54d49b9ec7a3 req-16db392d-9500-4857-bceb-4a794b559245 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Request body: {'port': {'security_groups': ['a6f2f987-e7b7-4ed2-ae1e-736f35635781']}} {{(pid=102324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 17:28:48.678835 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-598b57fa-8a03-43a9-83ca-29e053b5566c req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:48.748613 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Pushing event deleted for resources: {'Port': ['ID=b4e35d20-ba9e-4d75-94f0-d6e6b8972c78,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:28:48.754766 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-58b824aa-300a-45e8-af6c-54d49b9ec7a3 req-16db392d-9500-4857-bceb-4a794b559245 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-528496'] for port, before_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:48.764235 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:48.768167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:48.768167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:48.768167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:48.768167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:48.768167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:48.768167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:48.768167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:48.768167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:48.768167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:48.768167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:48.768167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:48.814664 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-598b57fa-8a03-43a9-83ca-29e053b5566c req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] No DVR routers for this DVR port b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 on host hv-cinder-69414 {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:28:48.836409 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-598b57fa-8a03-43a9-83ca-29e053b5566c req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:48.840943 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-598b57fa-8a03-43a9-83ca-29e053b5566c req-a2bcb4ef-1f91-443e-9b8f-93ce8d99972e tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.10 "DELETE /v2.0/ports/b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 HTTP/1.1" status: 204 len: 173 time: 0.7110145 Nov 11 17:28:48.841484 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8a8298b6-d69a-409b-b494-a28f3a458069', 'name': 'network-vif-deleted', 'tag': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:28:48.844244 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a19dea88-b0d0-435e-b821-5082c6633f88" -d '{"events": [{"server_uuid": "8a8298b6-d69a-409b-b494-a28f3a458069", "name": "network-vif-deleted", "tag": "b4e35d20-ba9e-4d75-94f0-d6e6b8972c78"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:28:48.900577 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:28:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4fd792ab-dc37-4ee8-b263-c6b3223c8ea4 x-openstack-request-id: req-4fd792ab-dc37-4ee8-b263-c6b3223c8ea4 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:28:48.900577 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8a8298b6-d69a-409b-b494-a28f3a458069", "name": "network-vif-deleted", "tag": "b4e35d20-ba9e-4d75-94f0-d6e6b8972c78", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:28:48.900577 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-4fd792ab-dc37-4ee8-b263-c6b3223c8ea4 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:28:48.900577 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8a8298b6-d69a-409b-b494-a28f3a458069', 'name': 'network-vif-deleted', 'tag': 'b4e35d20-ba9e-4d75-94f0-d6e6b8972c78', 'status': 'completed', 'code': 200} Nov 11 17:28:49.014008 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-537c55b5-ac2b-413c-8613-c1a12b11c2db req-720b73a9-0980-4984-ab2e-d47db94ca6ce tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 210 time: 0.0319643 Nov 11 17:28:49.063853 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-58b824aa-300a-45e8-af6c-54d49b9ec7a3 req-16db392d-9500-4857-bceb-4a794b559245 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] For port ece9e9ed-bd66-40e0-b970-a147e4852743, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=ece9e9ed-bd66-40e0-b970-a147e4852743,segment=NetworkSegment(228b04b9-98b7-47bd-a901-1be44f34a0f9),segment_id=228b04b9-98b7-47bd-a901-1be44f34a0f9)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:28:49.100702 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-58b824aa-300a-45e8-af6c-54d49b9ec7a3 req-16db392d-9500-4857-bceb-4a794b559245 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for port, precommit_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:49.159711 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-58b824aa-300a-45e8-af6c-54d49b9ec7a3 req-16db392d-9500-4857-bceb-4a794b559245 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8735338510219', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8735338080642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8735338080660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5436170'] for port, after_update {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:49.175515 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['ece9e9ed-bd66-40e0-b970-a147e4852743'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:28:49.235340 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58b824aa-300a-45e8-af6c-54d49b9ec7a3 req-16db392d-9500-4857-bceb-4a794b559245 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:49.236302 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-58b824aa-300a-45e8-af6c-54d49b9ec7a3 req-16db392d-9500-4857-bceb-4a794b559245 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:49.238432 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-58b824aa-300a-45e8-af6c-54d49b9ec7a3 req-16db392d-9500-4857-bceb-4a794b559245 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "PUT /v2.0/ports/ece9e9ed-bd66-40e0-b970-a147e4852743 HTTP/1.1" status: 200 len: 942 time: 0.6079268 Nov 11 17:28:49.253008 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38504) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:28:49.287437 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16db392d-9500-4857-bceb-4a794b559245 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Pushing event updated for resources: {'Port': ['ID=ece9e9ed-bd66-40e0-b970-a147e4852743,revision_number=7']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:28:49.321645 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['ece9e9ed-bd66-40e0-b970-a147e4852743'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:28:49.386865 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f95d5d2e-5176-4322-8763-1c89f8efe159 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:49.434578 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f95d5d2e-5176-4322-8763-1c89f8efe159 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:49.598862 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f95d5d2e-5176-4322-8763-1c89f8efe159 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:49.602709 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f95d5d2e-5176-4322-8763-1c89f8efe159 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:49.609043 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-f95d5d2e-5176-4322-8763-1c89f8efe159 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "DELETE /v2.0/security-groups/16b573d5-d5bb-418e-a88c-5b3305ec7b17 HTTP/1.1" status: 204 len: 168 time: 0.3497560 Nov 11 17:28:49.609284 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38508) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:28:49.615869 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f95d5d2e-5176-4322-8763-1c89f8efe159 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=16b573d5-d5bb-418e-a88c-5b3305ec7b17,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:28:49.622121 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.provisioning_blocks [None req-a2572140-9df9-408b-97e8-9a3d7d083c76 None None] Provisioning complete for port ece9e9ed-bd66-40e0-b970-a147e4852743 triggered by entity DHCP. {{(pid=102325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 17:28:49.622894 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-a2572140-9df9-408b-97e8-9a3d7d083c76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-705336'] for port, provisioning_complete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:49.813909 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-c31aee2f-a662-447f-9c96-f873d961b1ea tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Deleting port 16896aaf-7ae6-42ef-8c4f-8331c06582dd {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:28:49.814233 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c31aee2f-a662-447f-9c96-f873d961b1ea tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:49.913717 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c31aee2f-a662-447f-9c96-f873d961b1ea tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:49.914075 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c31aee2f-a662-447f-9c96-f873d961b1ea tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:49.934511 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-c31aee2f-a662-447f-9c96-f873d961b1ea tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Calling delete_port for 16896aaf-7ae6-42ef-8c4f-8331c06582dd owned by network:floatingip {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:28:50.182758 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-a043fdf8-d877-4b8e-b6a5-867a6c1424f4 req-89a0d5cb-1883-49d2-acac-98857b190b59 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "GET /v2.0/ports?device_id=8a8298b6-d69a-409b-b494-a28f3a458069 HTTP/1.1" status: 200 len: 210 time: 0.0336323 Nov 11 17:28:50.185029 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c31aee2f-a662-447f-9c96-f873d961b1ea tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:50.221806 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:28:50.253457 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c31aee2f-a662-447f-9c96-f873d961b1ea tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Pushing event deleted for resources: {'Port': ['ID=16896aaf-7ae6-42ef-8c4f-8331c06582dd,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:28:50.370660 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c31aee2f-a662-447f-9c96-f873d961b1ea tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks [] for floatingip, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:50.371222 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.db.l3_db [None req-c31aee2f-a662-447f-9c96-f873d961b1ea tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Floating IP df948f4d-ebe8-4b3c-b924-b23d8129aa29 disassociated (deleted). External IP: 172.27.1.36, port: ece9e9ed-bd66-40e0-b970-a147e4852743. Nov 11 17:28:50.680915 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c31aee2f-a662-447f-9c96-f873d961b1ea tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Router 0f921ab3-c03d-4722-9f80-7301a23dc466 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:28:50.855966 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c31aee2f-a662-447f-9c96-f873d961b1ea tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:28:50.866392 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c31aee2f-a662-447f-9c96-f873d961b1ea tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for floatingip, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:50.873875 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93881373-7d8d-4250-90e4-c93656cf0a19 None None] Sync routers for ids ['0f921ab3-c03d-4722-9f80-7301a23dc466'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:28:50.892568 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93881373-7d8d-4250-90e4-c93656cf0a19 None None] Routers {'0f921ab3-c03d-4722-9f80-7301a23dc466'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:28:50.893633 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-93881373-7d8d-4250-90e4-c93656cf0a19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:28:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['0f921ab3-c03d-4722-9f80-7301a23dc466'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:50.900022 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'tag': 'ece9e9ed-bd66-40e0-b970-a147e4852743'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:28:50.903308 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-999ceba7-04c3-49b7-9bdc-100900964b6d" -d '{"events": [{"name": "network-changed", "server_uuid": "bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6", "tag": "ece9e9ed-bd66-40e0-b970-a147e4852743"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:28:50.923436 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-c31aee2f-a662-447f-9c96-f873d961b1ea tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "DELETE /v2.0/floatingips/df948f4d-ebe8-4b3c-b924-b23d8129aa29 HTTP/1.1" status: 204 len: 168 time: 1.3136582 Nov 11 17:28:50.923823 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'tag': 'ece9e9ed-bd66-40e0-b970-a147e4852743'}] {{(pid=102323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:28:50.928441 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e403b61459b670e98b014c3cf3a329fbe6582d208e9ffc8ee013292e7540f2a7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-73087ef7-b23d-4fe7-ad16-e0fa660e16af" -d '{"events": [{"name": "network-changed", "server_uuid": "bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6", "tag": "ece9e9ed-bd66-40e0-b970-a147e4852743"}]}' {{(pid=102323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:28:50.974197 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:28:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e0dbed97-041d-40be-8aa8-2da65ef9bf71 x-openstack-request-id: req-e0dbed97-041d-40be-8aa8-2da65ef9bf71 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:28:50.974619 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6", "tag": "ece9e9ed-bd66-40e0-b970-a147e4852743", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:28:50.974961 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-e0dbed97-041d-40be-8aa8-2da65ef9bf71 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:28:50.975502 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'tag': 'ece9e9ed-bd66-40e0-b970-a147e4852743', 'status': 'completed', 'code': 200} Nov 11 17:28:51.051936 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 17:28:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-556ae2e5-7b6a-49f9-91b4-3063b8559b7f x-openstack-request-id: req-556ae2e5-7b6a-49f9-91b4-3063b8559b7f {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:28:51.052434 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6", "tag": "ece9e9ed-bd66-40e0-b970-a147e4852743", "status": "completed", "code": 200}]} {{(pid=102323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:28:51.052810 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-556ae2e5-7b6a-49f9-91b4-3063b8559b7f {{(pid=102323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:28:51.053422 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'tag': 'ece9e9ed-bd66-40e0-b970-a147e4852743', 'status': 'completed', 'code': 200} Nov 11 17:28:51.079456 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-999ceba7-04c3-49b7-9bdc-100900964b6d req-80f80605-a425-4abb-815e-50e56af9796f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:51.082195 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-999ceba7-04c3-49b7-9bdc-100900964b6d req-80f80605-a425-4abb-815e-50e56af9796f service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0918d6b635a04c89ae9c7253d1a3901f&device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 1098 time: 0.0650678 Nov 11 17:28:51.086083 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-93881373-7d8d-4250-90e4-c93656cf0a19 None None] Set router 0f921ab3-c03d-4722-9f80-7301a23dc466 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:28:51.268333 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-999ceba7-04c3-49b7-9bdc-100900964b6d req-dcace3e5-993d-4273-b599-6d235a8f2250 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:51.268502 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38524) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:28:51.268999 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-999ceba7-04c3-49b7-9bdc-100900964b6d req-dcace3e5-993d-4273-b599-6d235a8f2250 service neutron] 10.222.0.10 "GET /v2.0/networks?id=892c147f-3343-4b08-a9a7-9e968821be86 HTTP/1.1" status: 200 len: 915 time: 0.1729906 Nov 11 17:28:51.346326 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-999ceba7-04c3-49b7-9bdc-100900964b6d req-416b1923-1d21-48c9-b0d4-49beefe473a2 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ece9e9ed-bd66-40e0-b970-a147e4852743 HTTP/1.1" status: 200 len: 217 time: 0.0688133 Nov 11 17:28:51.378699 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-561ed1da-e677-4b88-a41e-6d02c0dcbb81 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:51.422341 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-93881373-7d8d-4250-90e4-c93656cf0a19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'name': 'tempest-TestMinimumBasicScenario-910390135-router', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:38Z', 'updated_at': '2021-11-11T17:26:42Z', 'revision_number': 4, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'gw_port': {'id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:7a:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:39Z', 'updated_at': '2021-11-11T17:26:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '47ad1537-84e2-4b23-9edf-269b2ea4d931', 'name': '', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'mac_address': 'fa:16:3e:a2:83:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:41Z', 'updated_at': '2021-11-11T17:26:46Z', 'revision_number': 5, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'subnets': [{'id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:51.433203 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-561ed1da-e677-4b88-a41e-6d02c0dcbb81 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:51.449861 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-999ceba7-04c3-49b7-9bdc-100900964b6d req-fe853432-35cf-4f56-a717-e5a543ca3865 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:51.453265 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-999ceba7-04c3-49b7-9bdc-100900964b6d req-fe853432-35cf-4f56-a717-e5a543ca3865 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=44d8c516-d4c3-4d4e-81bb-be7d2f3122ab HTTP/1.1" status: 200 len: 853 time: 0.0952995 Nov 11 17:28:51.491842 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93881373-7d8d-4250-90e4-c93656cf0a19 None None] Checking router: 0f921ab3-c03d-4722-9f80-7301a23dc466 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:28:51.523526 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93881373-7d8d-4250-90e4-c93656cf0a19 None None] Routers {'0f921ab3-c03d-4722-9f80-7301a23dc466'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:28:51.524273 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-93881373-7d8d-4250-90e4-c93656cf0a19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:28:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['0f921ab3-c03d-4722-9f80-7301a23dc466'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:51.536716 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-999ceba7-04c3-49b7-9bdc-100900964b6d req-b77cb94a-59a2-462a-9707-89c285cfabab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:51.540570 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-999ceba7-04c3-49b7-9bdc-100900964b6d req-b77cb94a-59a2-462a-9707-89c285cfabab service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=892c147f-3343-4b08-a9a7-9e968821be86&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0736949 Nov 11 17:28:51.623116 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-561ed1da-e677-4b88-a41e-6d02c0dcbb81 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:51.628386 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-561ed1da-e677-4b88-a41e-6d02c0dcbb81 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:51.634007 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-561ed1da-e677-4b88-a41e-6d02c0dcbb81 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] 10.222.0.16 "DELETE /v2.0/security-groups/b9ce3bfe-8c24-4f72-add6-2af585f671b3 HTTP/1.1" status: 204 len: 168 time: 0.3646486 Nov 11 17:28:51.673375 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-561ed1da-e677-4b88-a41e-6d02c0dcbb81 tempest-TestShelveInstance-1254596607 tempest-TestShelveInstance-1254596607-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b9ce3bfe-8c24-4f72-add6-2af585f671b3,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:28:51.684693 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-93881373-7d8d-4250-90e4-c93656cf0a19 None None] Set router 0f921ab3-c03d-4722-9f80-7301a23dc466 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:28:51.692321 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-999ceba7-04c3-49b7-9bdc-100900964b6d req-362cd504-dcdc-4dc8-b53b-7a55f5db95b0 service neutron] 10.222.0.10 "GET /v2.0/networks/892c147f-3343-4b08-a9a7-9e968821be86?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1327174 Nov 11 17:28:51.798782 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38530) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:28:51.851850 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-999ceba7-04c3-49b7-9bdc-100900964b6d req-792d9bf6-5725-49a7-9c4b-891defccf385 service neutron] 10.222.0.10 "GET /v2.0/networks/892c147f-3343-4b08-a9a7-9e968821be86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1500807 Nov 11 17:28:52.038743 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73087ef7-b23d-4fe7-ad16-e0fa660e16af req-e42fb8bf-ea74-40c2-b752-b22388f21a9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:52.041345 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-73087ef7-b23d-4fe7-ad16-e0fa660e16af req-e42fb8bf-ea74-40c2-b752-b22388f21a9a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0918d6b635a04c89ae9c7253d1a3901f&device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 1098 time: 0.0905228 Nov 11 17:28:52.121829 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:28:52.166497 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:28:52.167650 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device b4e35d20-ba9e-4d75-94f0-d6e6b8972c78 not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:28:52.196594 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-93881373-7d8d-4250-90e4-c93656cf0a19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'name': 'tempest-TestMinimumBasicScenario-910390135-router', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:38Z', 'updated_at': '2021-11-11T17:26:42Z', 'revision_number': 4, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'gw_port': {'id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:7a:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:39Z', 'updated_at': '2021-11-11T17:26:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '47ad1537-84e2-4b23-9edf-269b2ea4d931', 'name': '', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'mac_address': 'fa:16:3e:a2:83:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:41Z', 'updated_at': '2021-11-11T17:26:46Z', 'revision_number': 5, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'subnets': [{'id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:52.204099 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73087ef7-b23d-4fe7-ad16-e0fa660e16af req-9eb52d5b-16b0-4915-a269-1c859172e1d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:52.206967 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-73087ef7-b23d-4fe7-ad16-e0fa660e16af req-9eb52d5b-16b0-4915-a269-1c859172e1d4 service neutron] 10.222.0.10 "GET /v2.0/networks?id=892c147f-3343-4b08-a9a7-9e968821be86 HTTP/1.1" status: 200 len: 915 time: 0.1531782 Nov 11 17:28:52.228785 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93881373-7d8d-4250-90e4-c93656cf0a19 None None] The sync data for ids ['0f921ab3-c03d-4722-9f80-7301a23dc466'] in dv-cinder-694140-2-iscsi is: [{'id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'name': 'tempest-TestMinimumBasicScenario-910390135-router', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:38Z', 'updated_at': '2021-11-11T17:26:42Z', 'revision_number': 4, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'gw_port': {'id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:7a:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:39Z', 'updated_at': '2021-11-11T17:26:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi', '_interfaces': [{'id': '47ad1537-84e2-4b23-9edf-269b2ea4d931', 'name': '', 'network_id': '892c147f-3343-4b08-a9a7-9e968821be86', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'mac_address': 'fa:16:3e:a2:83:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:41Z', 'updated_at': '2021-11-11T17:26:46Z', 'revision_number': 5, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'subnets': [{'id': '44d8c516-d4c3-4d4e-81bb-be7d2f3122ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:28:52.275776 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-73087ef7-b23d-4fe7-ad16-e0fa660e16af req-4f608a0a-8c48-4e74-a9ba-c55e0d4e9893 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ece9e9ed-bd66-40e0-b970-a147e4852743 HTTP/1.1" status: 200 len: 217 time: 0.0599017 Nov 11 17:28:52.339947 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73087ef7-b23d-4fe7-ad16-e0fa660e16af req-b812c671-83d9-4ced-9cb0-161eff488daa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:52.341867 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-73087ef7-b23d-4fe7-ad16-e0fa660e16af req-b812c671-83d9-4ced-9cb0-161eff488daa service neutron] 10.222.0.10 "GET /v2.0/subnets?id=44d8c516-d4c3-4d4e-81bb-be7d2f3122ab HTTP/1.1" status: 200 len: 853 time: 0.0572650 Nov 11 17:28:52.404148 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73087ef7-b23d-4fe7-ad16-e0fa660e16af req-79009c1d-a4b8-4a39-81d7-e9bb6e28c846 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:52.406312 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-73087ef7-b23d-4fe7-ad16-e0fa660e16af req-79009c1d-a4b8-4a39-81d7-e9bb6e28c846 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=892c147f-3343-4b08-a9a7-9e968821be86&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0566909 Nov 11 17:28:52.562505 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-73087ef7-b23d-4fe7-ad16-e0fa660e16af req-a3778505-443d-440e-a76e-0be0192ebde8 service neutron] 10.222.0.10 "GET /v2.0/networks/892c147f-3343-4b08-a9a7-9e968821be86?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1426950 Nov 11 17:28:52.598090 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c258c042-58c9-4ae4-b158-e0ec6b33113b None None] New status for floating IP df948f4d-ebe8-4b3c-b924-b23d8129aa29: DOWN {{(pid=102326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 17:28:52.656280 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-08ee5659-363f-41e1-8b7e-ea898ee9cb59 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-394221'] for router_interface, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:52.761945 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-73087ef7-b23d-4fe7-ad16-e0fa660e16af req-d9209ee1-d75b-4bdd-8068-1cdee899bf0c service neutron] 10.222.0.10 "GET /v2.0/networks/892c147f-3343-4b08-a9a7-9e968821be86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1844938 Nov 11 17:28:53.013454 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-08ee5659-363f-41e1-8b7e-ea898ee9cb59 admin admin] Deleting port 27767633-1ab7-44d5-890c-4a3c38c807f6 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:28:53.013790 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-08ee5659-363f-41e1-8b7e-ea898ee9cb59 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:53.103883 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-08ee5659-363f-41e1-8b7e-ea898ee9cb59 admin admin] For port 27767633-1ab7-44d5-890c-4a3c38c807f6, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=27767633-1ab7-44d5-890c-4a3c38c807f6,segment=NetworkSegment(84e8dda5-3747-4e23-984b-1e3957701cfb),segment_id=84e8dda5-3747-4e23-984b-1e3957701cfb)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:28:53.104372 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-08ee5659-363f-41e1-8b7e-ea898ee9cb59 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:53.122659 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-08ee5659-363f-41e1-8b7e-ea898ee9cb59 admin admin] Calling delete_port for 27767633-1ab7-44d5-890c-4a3c38c807f6 owned by network:router_interface {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:28:53.406560 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-08ee5659-363f-41e1-8b7e-ea898ee9cb59 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:53.436308 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08ee5659-363f-41e1-8b7e-ea898ee9cb59 admin admin] Pushing event deleted for resources: {'Port': ['ID=27767633-1ab7-44d5-890c-4a3c38c807f6,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:28:53.644135 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-08ee5659-363f-41e1-8b7e-ea898ee9cb59 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8103781', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-393853'] for router_interface, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:53.959110 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-08ee5659-363f-41e1-8b7e-ea898ee9cb59 admin admin] Router fbdb60a9-d48f-44d5-a652-95278f391d51 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:28:54.104633 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-08ee5659-363f-41e1-8b7e-ea898ee9cb59 admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:28:54.111591 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-08ee5659-363f-41e1-8b7e-ea898ee9cb59 admin admin] 10.222.0.16 "PUT /v2.0/routers/fbdb60a9-d48f-44d5-a652-95278f391d51/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3105223 Nov 11 17:28:54.114987 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38546) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:28:54.120629 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80125a65-8924-4fb7-ae16-f2907d3583fa None None] Sync routers for ids ['fbdb60a9-d48f-44d5-a652-95278f391d51'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:28:54.132490 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80125a65-8924-4fb7-ae16-f2907d3583fa None None] Routers {'fbdb60a9-d48f-44d5-a652-95278f391d51'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:28:54.133706 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-80125a65-8924-4fb7-ae16-f2907d3583fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:28:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['fbdb60a9-d48f-44d5-a652-95278f391d51'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:54.297104 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-80125a65-8924-4fb7-ae16-f2907d3583fa None None] Set router fbdb60a9-d48f-44d5-a652-95278f391d51 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:28:54.528163 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bd4613c0-e2e6-479e-9447-1451b726f8f9 admin admin] Publish callbacks [] for router, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:54.597735 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-80125a65-8924-4fb7-ae16-f2907d3583fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'name': 'tempest-TestShelveInstance-1336680617-router', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13'}], 'enable_snat': True}, 'gw_port_id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:47Z', 'updated_at': '2021-11-11T17:28:53Z', 'revision_number': 5, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'gw_port': {'id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:48:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:48Z', 'updated_at': '2021-11-11T17:23:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:54.646585 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80125a65-8924-4fb7-ae16-f2907d3583fa None None] Checking router: fbdb60a9-d48f-44d5-a652-95278f391d51 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:28:54.661292 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80125a65-8924-4fb7-ae16-f2907d3583fa None None] Routers {'fbdb60a9-d48f-44d5-a652-95278f391d51'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:28:54.662327 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-80125a65-8924-4fb7-ae16-f2907d3583fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:28:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['fbdb60a9-d48f-44d5-a652-95278f391d51'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:54.677786 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bd4613c0-e2e6-479e-9447-1451b726f8f9 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:54.801550 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-bd4613c0-e2e6-479e-9447-1451b726f8f9 admin admin] Deleting port 312d3448-1034-4dc3-8ce7-a0402912f35d {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:28:54.802019 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bd4613c0-e2e6-479e-9447-1451b726f8f9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:54.814619 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-80125a65-8924-4fb7-ae16-f2907d3583fa None None] Set router fbdb60a9-d48f-44d5-a652-95278f391d51 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:28:54.912784 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-bd4613c0-e2e6-479e-9447-1451b726f8f9 admin admin] For port 312d3448-1034-4dc3-8ce7-a0402912f35d, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=312d3448-1034-4dc3-8ce7-a0402912f35d,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:28:54.913326 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bd4613c0-e2e6-479e-9447-1451b726f8f9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:54.930621 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-bd4613c0-e2e6-479e-9447-1451b726f8f9 admin admin] Calling delete_port for 312d3448-1034-4dc3-8ce7-a0402912f35d owned by network:router_gateway {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:28:55.102296 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-80125a65-8924-4fb7-ae16-f2907d3583fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'name': 'tempest-TestShelveInstance-1336680617-router', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13'}], 'enable_snat': True}, 'gw_port_id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:47Z', 'updated_at': '2021-11-11T17:28:53Z', 'revision_number': 5, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'gw_port': {'id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:48:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:48Z', 'updated_at': '2021-11-11T17:23:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:55.143736 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80125a65-8924-4fb7-ae16-f2907d3583fa None None] The sync data for ids ['fbdb60a9-d48f-44d5-a652-95278f391d51'] in dv-cinder-694140-2-iscsi is: [{'id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'name': 'tempest-TestShelveInstance-1336680617-router', 'tenant_id': '53c4ca7574da4b2a868a39a52a98e620', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13'}], 'enable_snat': True}, 'gw_port_id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:47Z', 'updated_at': '2021-11-11T17:28:53Z', 'revision_number': 5, 'project_id': '53c4ca7574da4b2a868a39a52a98e620', 'gw_port': {'id': '312d3448-1034-4dc3-8ce7-a0402912f35d', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:48:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbdb60a9-d48f-44d5-a652-95278f391d51', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:48Z', 'updated_at': '2021-11-11T17:23:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:28:55.256567 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bd4613c0-e2e6-479e-9447-1451b726f8f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:55.287213 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd4613c0-e2e6-479e-9447-1451b726f8f9 admin admin] Pushing event deleted for resources: {'Port': ['ID=312d3448-1034-4dc3-8ce7-a0402912f35d,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:28:55.354262 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bd4613c0-e2e6-479e-9447-1451b726f8f9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-397207'] for router_gateway, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:55.462739 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bd4613c0-e2e6-479e-9447-1451b726f8f9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-424448', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7353'] for router, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:55.464880 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bd4613c0-e2e6-479e-9447-1451b726f8f9 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:55.594375 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bd4613c0-e2e6-479e-9447-1451b726f8f9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-424459'] for router, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:55.595212 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd4613c0-e2e6-479e-9447-1451b726f8f9 admin admin] Fanout notify agent at l3_agent the message router_deleted on router fbdb60a9-d48f-44d5-a652-95278f391d51 {{(pid=102323) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 17:28:55.600809 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-bd4613c0-e2e6-479e-9447-1451b726f8f9 admin admin] Publish callbacks [] for router, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:55.602210 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-bd4613c0-e2e6-479e-9447-1451b726f8f9 admin admin] 10.222.0.16 "DELETE /v2.0/routers/fbdb60a9-d48f-44d5-a652-95278f391d51 HTTP/1.1" status: 204 len: 168 time: 1.4856157 Nov 11 17:28:55.611738 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38554) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:28:55.636065 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-361bdf70-72a2-48e3-84ee-edf6780da19a req-4fdbc0fa-9877-4012-a2b7-99c2fa05fc0c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:55.638526 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-361bdf70-72a2-48e3-84ee-edf6780da19a req-4fdbc0fa-9877-4012-a2b7-99c2fa05fc0c tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 945 time: 0.0560844 Nov 11 17:28:55.673675 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_v2 [None req-c1a864b0-ea9a-4f75-93d0-c39233afe049 admin admin] Deleting subnet 45e5a299-340d-4f14-b0eb-66727a394b7c {{(pid=102323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:28:55.677219 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c1a864b0-ea9a-4f75-93d0-c39233afe049 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:55.714911 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-361bdf70-72a2-48e3-84ee-edf6780da19a req-c864dc4d-3377-4ee9-a112-95910bf2436d tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667908 Nov 11 17:28:55.734036 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c1a864b0-ea9a-4f75-93d0-c39233afe049 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5777079'] for subnet, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:55.785842 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 27767633-1ab7-44d5-890c-4a3c38c807f6 no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:28:55.810604 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: 27767633-1ab7-44d5-890c-4a3c38c807f6 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:28:55.810923 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 27767633-1ab7-44d5-890c-4a3c38c807f6 not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:28:55.864199 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c1a864b0-ea9a-4f75-93d0-c39233afe049 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:56.029568 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c1a864b0-ea9a-4f75-93d0-c39233afe049 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5720643', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5388326'] for subnet, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:56.063768 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1a864b0-ea9a-4f75-93d0-c39233afe049 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=45e5a299-340d-4f14-b0eb-66727a394b7c,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:28:56.066056 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c1a864b0-ea9a-4f75-93d0-c39233afe049 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:56.069693 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-c1a864b0-ea9a-4f75-93d0-c39233afe049 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/45e5a299-340d-4f14-b0eb-66727a394b7c HTTP/1.1" status: 204 len: 168 time: 0.4627297 Nov 11 17:28:56.073586 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38556) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:28:56.074703 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29a50f26-db72-4262-8df5-486a625ad859 None None] Network e1e04a10-fb62-4a0a-a705-82de35b80b1b requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:28:56.155889 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:56.223170 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] Deleting port d1ed592c-d33b-407d-b4c7-99da73461b7b {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:28:56.223515 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:56.294700 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] For port d1ed592c-d33b-407d-b4c7-99da73461b7b, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=d1ed592c-d33b-407d-b4c7-99da73461b7b,segment=NetworkSegment(84e8dda5-3747-4e23-984b-1e3957701cfb),segment_id=84e8dda5-3747-4e23-984b-1e3957701cfb)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:28:56.295419 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:56.310042 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] Calling delete_port for d1ed592c-d33b-407d-b4c7-99da73461b7b owned by network:dhcp {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:28:56.337880 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] DHCP port deletion for e1e04a10-fb62-4a0a-a705-82de35b80b1b request from dv-cinder-694140-2-iscsi {{(pid=102325) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 11 17:28:56.390878 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Deleting port d1ed592c-d33b-407d-b4c7-99da73461b7b {{(pid=102325) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:28:56.391518 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:56.461838 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] For port d1ed592c-d33b-407d-b4c7-99da73461b7b, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=d1ed592c-d33b-407d-b4c7-99da73461b7b,segment=NetworkSegment(84e8dda5-3747-4e23-984b-1e3957701cfb),segment_id=84e8dda5-3747-4e23-984b-1e3957701cfb)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:28:56.462239 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:56.477211 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Calling delete_port for d1ed592c-d33b-407d-b4c7-99da73461b7b owned by network:dhcp {{(pid=102325) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:28:56.526041 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:56.557270 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] Pushing event deleted for resources: {'Port': ['ID=d1ed592c-d33b-407d-b4c7-99da73461b7b,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:28:56.560946 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] No DVR routers for this DVR port d1ed592c-d33b-407d-b4c7-99da73461b7b on host dv-cinder-694140-2-iscsi {{(pid=102323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:28:56.574468 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633'] for port, after_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:56.621804 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Pushing event deleted for resources: {'Port': ['ID=d1ed592c-d33b-407d-b4c7-99da73461b7b,revision_number=None']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:28:56.636896 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] No DVR routers for this DVR port d1ed592c-d33b-407d-b4c7-99da73461b7b on host dv-cinder-694140-2-iscsi {{(pid=102325) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:28:56.640968 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:56.641543 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:56.642126 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:56.642741 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:56.643404 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:56.643966 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:56.644513 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:56.645102 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:56.645640 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:56.646037 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:56.646565 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:56.647203 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37dd7b4f-d29b-4376-a37f-40fcca4d7d01 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-694140-2-iscsi {{(pid=102325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 17:28:56.650966 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:56.676122 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e1e04a10-fb62-4a0a-a705-82de35b80b1b']}} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:56.689071 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '84e8dda5-3747-4e23-984b-1e3957701cfb') {'for_net_delete': True} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:56.689798 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '84e8dda5-3747-4e23-984b-1e3957701cfb') {} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:56.709683 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5777070'] for segment, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:56.733263 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:56.740267 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] Releasing vlan 548 on physical network physnet1 to pool {{(pid=102323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:28:56.740669 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5720605'] for segment, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: Traceback (most recent call last): Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: timer() Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: cb(*args, **kw) Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: return func(*args, **kwargs) Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: self._notify() Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: self.callback(batched_events) Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: event.method(event) Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: return f(self, *a, **k) Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._get(url).json() Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: return self.request(url, 'GET', **kwargs) Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:28:56.742696 dv-cinder-694140-2-iscsi neutron-server[102323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:28:56.867564 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad7e0cde-ae57-4671-9c46-15e7e3448de6 req-87a6b15e-ea52-45f2-ba9c-9316a85cfd93 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:56.869134 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ad7e0cde-ae57-4671-9c46-15e7e3448de6 req-87a6b15e-ea52-45f2-ba9c-9316a85cfd93 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 945 time: 0.0580080 Nov 11 17:28:56.924371 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [req-ad7e0cde-ae57-4671-9c46-15e7e3448de6 req-c322ffbd-7c84-4efc-a657-8328bf2da6e5 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475736 Nov 11 17:28:56.944238 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:56.944597 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:56.953571 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] 10.222.0.16 "DELETE /v2.0/networks/e1e04a10-fb62-4a0a-a705-82de35b80b1b HTTP/1.1" status: 204 len: 168 time: 0.8748488 Nov 11 17:28:56.954079 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38560) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:28:56.971673 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0cdccc4-dd34-4bd5-a3ea-5578d2094a42 admin admin] Pushing event deleted for resources: {'Network': ['ID=e1e04a10-fb62-4a0a-a705-82de35b80b1b,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:28:57.373347 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-efa7cc6a-cd17-4721-9c50-436f7176ec35 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-394221'] for router_interface, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:57.522030 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b8d9cb-f32f-425b-9bcd-1b4f86e8f717 req-77707d90-11e2-4514-8069-b00e87a19bf0 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:57.524130 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-83b8d9cb-f32f-425b-9bcd-1b4f86e8f717 req-77707d90-11e2-4514-8069-b00e87a19bf0 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.10 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 945 time: 0.0600920 Nov 11 17:28:57.659627 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-efa7cc6a-cd17-4721-9c50-436f7176ec35 admin admin] Deleting port c6384c39-1e15-446b-98aa-e19adbecc47a {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:28:57.659971 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-efa7cc6a-cd17-4721-9c50-436f7176ec35 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:57.761851 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-efa7cc6a-cd17-4721-9c50-436f7176ec35 admin admin] For port c6384c39-1e15-446b-98aa-e19adbecc47a, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=c6384c39-1e15-446b-98aa-e19adbecc47a,segment=NetworkSegment(110e841e-0526-4369-97dd-11f0bc420155),segment_id=110e841e-0526-4369-97dd-11f0bc420155)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:28:57.762143 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-efa7cc6a-cd17-4721-9c50-436f7176ec35 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:57.778987 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-efa7cc6a-cd17-4721-9c50-436f7176ec35 admin admin] Calling delete_port for c6384c39-1e15-446b-98aa-e19adbecc47a owned by network:router_interface {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:28:57.784259 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 312d3448-1034-4dc3-8ce7-a0402912f35d no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:28:57.810703 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: 312d3448-1034-4dc3-8ce7-a0402912f35d {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:28:57.811047 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 312d3448-1034-4dc3-8ce7-a0402912f35d not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:28:57.812197 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device d1ed592c-d33b-407d-b4c7-99da73461b7b no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:28:57.834201 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: d1ed592c-d33b-407d-b4c7-99da73461b7b {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:28:57.834536 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device d1ed592c-d33b-407d-b4c7-99da73461b7b not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:28:57.942276 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-83b8d9cb-f32f-425b-9bcd-1b4f86e8f717 req-f27dd36f-d560-4aa2-abee-3cde61b3a987 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Deleting port ece9e9ed-bd66-40e0-b970-a147e4852743 {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:28:57.942782 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-83b8d9cb-f32f-425b-9bcd-1b4f86e8f717 req-f27dd36f-d560-4aa2-abee-3cde61b3a987 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:58.094790 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [req-83b8d9cb-f32f-425b-9bcd-1b4f86e8f717 req-f27dd36f-d560-4aa2-abee-3cde61b3a987 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] For port ece9e9ed-bd66-40e0-b970-a147e4852743, host hv-cinder-69414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-69414',level=0,port_id=ece9e9ed-bd66-40e0-b970-a147e4852743,segment=NetworkSegment(228b04b9-98b7-47bd-a901-1be44f34a0f9),segment_id=228b04b9-98b7-47bd-a901-1be44f34a0f9)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:28:58.095133 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-83b8d9cb-f32f-425b-9bcd-1b4f86e8f717 req-f27dd36f-d560-4aa2-abee-3cde61b3a987 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:58.105187 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ac7a73-fedc-4959-80a8-695231ff08f4 req-74715f1e-db93-4f96-9b36-7da1c79f048e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 17:28:58.106883 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-01ac7a73-fedc-4959-80a8-695231ff08f4 req-74715f1e-db93-4f96-9b36-7da1c79f048e tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 945 time: 0.0893869 Nov 11 17:28:58.124612 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [req-83b8d9cb-f32f-425b-9bcd-1b4f86e8f717 req-f27dd36f-d560-4aa2-abee-3cde61b3a987 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Calling delete_port for ece9e9ed-bd66-40e0-b970-a147e4852743 owned by compute:nova {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:28:58.131425 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-efa7cc6a-cd17-4721-9c50-436f7176ec35 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:58.160492 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efa7cc6a-cd17-4721-9c50-436f7176ec35 admin admin] Pushing event deleted for resources: {'Port': ['ID=c6384c39-1e15-446b-98aa-e19adbecc47a,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:28:58.210188 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-01ac7a73-fedc-4959-80a8-695231ff08f4 req-3e4d3de8-e36d-4ee8-b31f-1e1057e0d12d tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/security-groups?id=a6f2f987-e7b7-4ed2-ae1e-736f35635781&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0950677 Nov 11 17:28:58.349184 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-efa7cc6a-cd17-4721-9c50-436f7176ec35 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8103781', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-393853'] for router_interface, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:58.405919 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-83b8d9cb-f32f-425b-9bcd-1b4f86e8f717 req-f27dd36f-d560-4aa2-abee-3cde61b3a987 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:58.422935 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] get_ports_and_sgs() called for port_ids ['ece9e9ed-bd66-40e0-b970-a147e4852743'] {{(pid=102325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 17:28:58.451667 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f27dd36f-d560-4aa2-abee-3cde61b3a987 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Pushing event deleted for resources: {'Port': ['ID=ece9e9ed-bd66-40e0-b970-a147e4852743,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:28:58.496459 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [req-83b8d9cb-f32f-425b-9bcd-1b4f86e8f717 req-f27dd36f-d560-4aa2-abee-3cde61b3a987 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] No DVR routers for this DVR port ece9e9ed-bd66-40e0-b970-a147e4852743 on host hv-cinder-69414 {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:28:58.499357 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [req-83b8d9cb-f32f-425b-9bcd-1b4f86e8f717 req-f27dd36f-d560-4aa2-abee-3cde61b3a987 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-87014'] for port, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:58.502881 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-83b8d9cb-f32f-425b-9bcd-1b4f86e8f717 req-f27dd36f-d560-4aa2-abee-3cde61b3a987 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.10 "DELETE /v2.0/ports/ece9e9ed-bd66-40e0-b970-a147e4852743 HTTP/1.1" status: 204 len: 173 time: 0.9635518 Nov 11 17:28:58.503453 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'name': 'network-vif-deleted', 'tag': 'ece9e9ed-bd66-40e0-b970-a147e4852743'}] {{(pid=102324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 17:28:58.505780 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1633425d99a2ed5763cb383b3c0ecd922102cb9c474f5f1424b970e56d51f39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6ba02778-7c82-456e-8f8f-5ec012e4190e" -d '{"events": [{"server_uuid": "bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6", "name": "network-vif-deleted", "tag": "ece9e9ed-bd66-40e0-b970-a147e4852743"}]}' {{(pid=102324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 17:28:58.564258 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 17:28:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9f7e2162-a3fe-4a3d-a85f-572d7c8be514 x-openstack-request-id: req-9f7e2162-a3fe-4a3d-a85f-572d7c8be514 {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 17:28:58.565309 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6", "name": "network-vif-deleted", "tag": "ece9e9ed-bd66-40e0-b970-a147e4852743", "status": "completed", "code": 200}]} {{(pid=102324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 17:28:58.565309 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-9f7e2162-a3fe-4a3d-a85f-572d7c8be514 {{(pid=102324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 17:28:58.565879 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6', 'name': 'network-vif-deleted', 'tag': 'ece9e9ed-bd66-40e0-b970-a147e4852743', 'status': 'completed', 'code': 200} Nov 11 17:28:58.646928 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-efa7cc6a-cd17-4721-9c50-436f7176ec35 admin admin] Router 3a394120-b947-4f24-bed7-90459f716ef2 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:28:58.762222 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-efa7cc6a-cd17-4721-9c50-436f7176ec35 admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:28:58.767442 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-efa7cc6a-cd17-4721-9c50-436f7176ec35 admin admin] 10.222.0.16 "PUT /v2.0/routers/3a394120-b947-4f24-bed7-90459f716ef2/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8120778 Nov 11 17:28:58.771419 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38566) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:28:58.775723 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a878115-27f8-4bcf-bdd2-5902bec5de49 None None] Sync routers for ids ['3a394120-b947-4f24-bed7-90459f716ef2'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:28:58.794770 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a878115-27f8-4bcf-bdd2-5902bec5de49 None None] Routers {'3a394120-b947-4f24-bed7-90459f716ef2'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:28:58.796086 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-4a878115-27f8-4bcf-bdd2-5902bec5de49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:28:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['3a394120-b947-4f24-bed7-90459f716ef2'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:58.892419 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-342eded3-46d8-452b-938d-261ce889e479 admin admin] Publish callbacks [] for router, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:58.955063 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-4a878115-27f8-4bcf-bdd2-5902bec5de49 None None] Set router 3a394120-b947-4f24-bed7-90459f716ef2 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:28:59.056097 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-342eded3-46d8-452b-938d-261ce889e479 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:59.193309 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-4a878115-27f8-4bcf-bdd2-5902bec5de49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a394120-b947-4f24-bed7-90459f716ef2', 'name': 'tempest-TestShelveInstance-639218667-router', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.37'}], 'enable_snat': True}, 'gw_port_id': '3a14f879-20b5-41bd-b3be-a801454d0987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:56Z', 'updated_at': '2021-11-11T17:28:58Z', 'revision_number': 5, 'project_id': '8095b1a7a6bf4328a88245aa063676bf', 'gw_port': {'id': '3a14f879-20b5-41bd-b3be-a801454d0987', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:da:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a394120-b947-4f24-bed7-90459f716ef2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 621, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.37', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:23:56Z', 'updated_at': '2021-11-11T17:24:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:59.195322 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-342eded3-46d8-452b-938d-261ce889e479 admin admin] Deleting port 3a14f879-20b5-41bd-b3be-a801454d0987 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:28:59.195851 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-342eded3-46d8-452b-938d-261ce889e479 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:59.222915 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a878115-27f8-4bcf-bdd2-5902bec5de49 None None] Checking router: 3a394120-b947-4f24-bed7-90459f716ef2 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:28:59.233558 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a878115-27f8-4bcf-bdd2-5902bec5de49 None None] Routers {'3a394120-b947-4f24-bed7-90459f716ef2'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:28:59.234182 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-4a878115-27f8-4bcf-bdd2-5902bec5de49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:28:33Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['3a394120-b947-4f24-bed7-90459f716ef2'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:59.322756 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-342eded3-46d8-452b-938d-261ce889e479 admin admin] For port 3a14f879-20b5-41bd-b3be-a801454d0987, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=3a14f879-20b5-41bd-b3be-a801454d0987,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:28:59.323257 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-342eded3-46d8-452b-938d-261ce889e479 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:59.335841 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [req-c5fd2286-3bcc-4cb4-a256-69ec28d2ae75 req-4f97ffe4-2377-49a1-8540-cf2d8b39ae47 tempest-TestMinimumBasicScenario-2082829872 tempest-TestMinimumBasicScenario-2082829872-project] 10.222.0.16 "GET /v2.0/ports?device_id=bf23faa3-b4d2-4c20-a85c-ff9566ec2ae6 HTTP/1.1" status: 200 len: 210 time: 0.0332839 Nov 11 17:28:59.342586 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-342eded3-46d8-452b-938d-261ce889e479 admin admin] Calling delete_port for 3a14f879-20b5-41bd-b3be-a801454d0987 owned by network:router_gateway {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:28:59.377815 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-4a878115-27f8-4bcf-bdd2-5902bec5de49 None None] Set router 3a394120-b947-4f24-bed7-90459f716ef2 gateway port host: None {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:28:59.481649 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-4a878115-27f8-4bcf-bdd2-5902bec5de49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a394120-b947-4f24-bed7-90459f716ef2', 'name': 'tempest-TestShelveInstance-639218667-router', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:56Z', 'updated_at': '2021-11-11T17:28:59Z', 'revision_number': 6, 'project_id': '8095b1a7a6bf4328a88245aa063676bf', 'gw_port_host': None}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:28:59.615237 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a878115-27f8-4bcf-bdd2-5902bec5de49 None None] The sync data for ids ['3a394120-b947-4f24-bed7-90459f716ef2'] in dv-cinder-694140-2-iscsi is: [{'id': '3a394120-b947-4f24-bed7-90459f716ef2', 'name': 'tempest-TestShelveInstance-639218667-router', 'tenant_id': '8095b1a7a6bf4328a88245aa063676bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:23:56Z', 'updated_at': '2021-11-11T17:28:59Z', 'revision_number': 6, 'project_id': '8095b1a7a6bf4328a88245aa063676bf', 'gw_port_host': None}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:28:59.708664 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-342eded3-46d8-452b-938d-261ce889e479 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:59.736501 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-342eded3-46d8-452b-938d-261ce889e479 admin admin] Pushing event deleted for resources: {'Port': ['ID=3a14f879-20b5-41bd-b3be-a801454d0987,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:28:59.800530 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-342eded3-46d8-452b-938d-261ce889e479 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-397207'] for router_gateway, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:59.903044 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-342eded3-46d8-452b-938d-261ce889e479 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-424448', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7353'] for router, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:28:59.905456 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-342eded3-46d8-452b-938d-261ce889e479 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:00.103636 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device c6384c39-1e15-446b-98aa-e19adbecc47a no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:29:00.130166 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: c6384c39-1e15-446b-98aa-e19adbecc47a {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:29:00.130509 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device c6384c39-1e15-446b-98aa-e19adbecc47a not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:29:00.389494 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-342eded3-46d8-452b-938d-261ce889e479 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-424459'] for router, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:00.390614 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-342eded3-46d8-452b-938d-261ce889e479 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3a394120-b947-4f24-bed7-90459f716ef2 {{(pid=102323) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 17:29:00.398105 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-342eded3-46d8-452b-938d-261ce889e479 admin admin] Publish callbacks [] for router, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:00.402796 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-342eded3-46d8-452b-938d-261ce889e479 admin admin] 10.222.0.16 "DELETE /v2.0/routers/3a394120-b947-4f24-bed7-90459f716ef2 HTTP/1.1" status: 204 len: 168 time: 1.6275415 Nov 11 17:29:00.403191 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38574) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:00.468602 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_v2 [None req-f8521c82-1167-405e-a2fe-a31771037aeb admin admin] Deleting subnet 62e9b4fb-76e3-4652-bdd9-ec31fd104157 {{(pid=102323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:29:00.473382 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f8521c82-1167-405e-a2fe-a31771037aeb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:00.526443 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f8521c82-1167-405e-a2fe-a31771037aeb admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5777079'] for subnet, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:00.641291 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f8521c82-1167-405e-a2fe-a31771037aeb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:00.826077 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f8521c82-1167-405e-a2fe-a31771037aeb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5720643', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5388326'] for subnet, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:00.862692 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8521c82-1167-405e-a2fe-a31771037aeb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=62e9b4fb-76e3-4652-bdd9-ec31fd104157,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:00.868566 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-f8521c82-1167-405e-a2fe-a31771037aeb admin admin] Publish callbacks [] for subnet, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:00.874390 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-f8521c82-1167-405e-a2fe-a31771037aeb admin admin] 10.222.0.16 "DELETE /v2.0/subnets/62e9b4fb-76e3-4652-bdd9-ec31fd104157 HTTP/1.1" status: 204 len: 168 time: 0.4695706 Nov 11 17:29:00.877870 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38600) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:00.900952 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cdbd34b6-3b9c-4640-8eab-386190c3728f None None] Network 42706a37-4e5e-4c27-977c-73e50e8cd1d2 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:29:00.972117 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-e7296979-aa3d-4ac3-8c01-745e3969a213 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:01.029950 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:01.119112 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d46b2eb-8832-499f-b77d-490a6a719802 None None] DHCP port deletion for 42706a37-4e5e-4c27-977c-73e50e8cd1d2 request from dv-cinder-694140-2-iscsi {{(pid=102325) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 11 17:29:01.119851 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] Deleting port c5dc949a-ac8b-4fe8-947c-4a1081166158 {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:29:01.120073 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:01.205227 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] For port c5dc949a-ac8b-4fe8-947c-4a1081166158, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=c5dc949a-ac8b-4fe8-947c-4a1081166158,segment=NetworkSegment(110e841e-0526-4369-97dd-11f0bc420155),segment_id=110e841e-0526-4369-97dd-11f0bc420155)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:29:01.205857 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:01.219853 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-8d46b2eb-8832-499f-b77d-490a6a719802 None None] Deleting port c5dc949a-ac8b-4fe8-947c-4a1081166158 {{(pid=102325) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:29:01.220287 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-8d46b2eb-8832-499f-b77d-490a6a719802 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:01.233280 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] Calling delete_port for c5dc949a-ac8b-4fe8-947c-4a1081166158 owned by network:dhcp {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:29:01.313703 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-8d46b2eb-8832-499f-b77d-490a6a719802 None None] For port c5dc949a-ac8b-4fe8-947c-4a1081166158, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=c5dc949a-ac8b-4fe8-947c-4a1081166158,segment=NetworkSegment(110e841e-0526-4369-97dd-11f0bc420155),segment_id=110e841e-0526-4369-97dd-11f0bc420155)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:29:01.314106 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-8d46b2eb-8832-499f-b77d-490a6a719802 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:01.331328 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-8d46b2eb-8832-499f-b77d-490a6a719802 None None] Calling delete_port for c5dc949a-ac8b-4fe8-947c-4a1081166158 owned by network:dhcp {{(pid=102325) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:29:01.447186 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:01.490362 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] Pushing event deleted for resources: {'Port': ['ID=c5dc949a-ac8b-4fe8-947c-4a1081166158,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:01.497598 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] No DVR routers for this DVR port c5dc949a-ac8b-4fe8-947c-4a1081166158 on host dv-cinder-694140-2-iscsi {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:29:01.558850 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-8d46b2eb-8832-499f-b77d-490a6a719802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633'] for port, after_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:01.593401 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d46b2eb-8832-499f-b77d-490a6a719802 None None] Pushing event deleted for resources: {'Port': ['ID=c5dc949a-ac8b-4fe8-947c-4a1081166158,revision_number=None']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:01.605163 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d46b2eb-8832-499f-b77d-490a6a719802 None None] No DVR routers for this DVR port c5dc949a-ac8b-4fe8-947c-4a1081166158 on host dv-cinder-694140-2-iscsi {{(pid=102325) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:29:01.609413 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:01.641422 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['42706a37-4e5e-4c27-977c-73e50e8cd1d2']}} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:01.652978 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '110e841e-0526-4369-97dd-11f0bc420155') {'for_net_delete': True} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:01.653330 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '110e841e-0526-4369-97dd-11f0bc420155') {} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:01.673021 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5895812'] for segment, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:01.695073 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:01.705360 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] Releasing vlan 545 on physical network physnet1 to pool {{(pid=102324) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:29:01.705773 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5436270'] for segment, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: Traceback (most recent call last): Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: timer() Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: cb(*args, **kw) Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: return func(*args, **kwargs) Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: self._notify() Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: self.callback(batched_events) Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: event.method(event) Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: return f(self, *a, **k) Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: return self._get(url).json() Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: return self.request(url, 'GET', **kwargs) Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:29:01.708167 dv-cinder-694140-2-iscsi neutron-server[102324]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:29:01.785701 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device c5dc949a-ac8b-4fe8-947c-4a1081166158 no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:29:01.808192 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: c5dc949a-ac8b-4fe8-947c-4a1081166158 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:29:01.808564 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device c5dc949a-ac8b-4fe8-947c-4a1081166158 not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:29:01.808972 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 3a14f879-20b5-41bd-b3be-a801454d0987 no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:29:01.830684 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: 3a14f879-20b5-41bd-b3be-a801454d0987 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:29:01.831029 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 3a14f879-20b5-41bd-b3be-a801454d0987 not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:29:01.835584 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:01.847043 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:01.851859 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] 10.222.0.16 "DELETE /v2.0/networks/42706a37-4e5e-4c27-977c-73e50e8cd1d2 HTTP/1.1" status: 204 len: 168 time: 0.9725749 Nov 11 17:29:01.862920 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f29b38d-5807-4139-95c4-7cf8139cac26 admin admin] Pushing event deleted for resources: {'Network': ['ID=42706a37-4e5e-4c27-977c-73e50e8cd1d2,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:02.153860 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device ece9e9ed-bd66-40e0-b970-a147e4852743 no longer exists at agent hyperv_hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:29:02.186155 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38624) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:02.188903 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] No Port match for: ece9e9ed-bd66-40e0-b970-a147e4852743 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:29:02.189492 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Device ece9e9ed-bd66-40e0-b970-a147e4852743 not bound to the agent host hv-cinder-69414 {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:29:02.283827 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38626) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:02.357085 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-0c885c50-b61b-4716-a61c-6dbaa24f1785 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=53c4ca7574da4b2a868a39a52a98e620&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0709918 Nov 11 17:29:02.360447 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38628) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:02.420483 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b2244fb9-0e5a-4b10-92bb-98cf25cc6ef5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:02.445249 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b2244fb9-0e5a-4b10-92bb-98cf25cc6ef5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:02.577830 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b2244fb9-0e5a-4b10-92bb-98cf25cc6ef5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:02.581006 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-b2244fb9-0e5a-4b10-92bb-98cf25cc6ef5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:02.582326 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-b2244fb9-0e5a-4b10-92bb-98cf25cc6ef5 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/eab779ed-63d2-410a-8554-56ccc0c5f358 HTTP/1.1" status: 204 len: 168 time: 0.2206511 Nov 11 17:29:02.592914 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2244fb9-0e5a-4b10-92bb-98cf25cc6ef5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eab779ed-63d2-410a-8554-56ccc0c5f358,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:02.770079 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ab693f37-8c0a-4ede-8c72-6c0be5163187 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-394221'] for router_interface, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:03.098975 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-ab693f37-8c0a-4ede-8c72-6c0be5163187 admin admin] Deleting port 47ad1537-84e2-4b23-9edf-269b2ea4d931 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:29:03.099533 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ab693f37-8c0a-4ede-8c72-6c0be5163187 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:03.194862 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-ab693f37-8c0a-4ede-8c72-6c0be5163187 admin admin] For port 47ad1537-84e2-4b23-9edf-269b2ea4d931, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=47ad1537-84e2-4b23-9edf-269b2ea4d931,segment=NetworkSegment(228b04b9-98b7-47bd-a901-1be44f34a0f9),segment_id=228b04b9-98b7-47bd-a901-1be44f34a0f9)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:29:03.195548 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ab693f37-8c0a-4ede-8c72-6c0be5163187 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:03.209377 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-ab693f37-8c0a-4ede-8c72-6c0be5163187 admin admin] Calling delete_port for 47ad1537-84e2-4b23-9edf-269b2ea4d931 owned by network:router_interface {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:29:03.431188 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38634) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:03.481678 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-25974489-ac4f-4159-ac57-4ca789987928 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=8095b1a7a6bf4328a88245aa063676bf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0486469 Nov 11 17:29:03.482863 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ab693f37-8c0a-4ede-8c72-6c0be5163187 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:03.484305 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38636) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:03.516105 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab693f37-8c0a-4ede-8c72-6c0be5163187 admin admin] Pushing event deleted for resources: {'Port': ['ID=47ad1537-84e2-4b23-9edf-269b2ea4d931,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:03.555772 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd8ad852-0a40-4500-bda3-a519e3678aa5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:03.570330 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-35276917-ba97-4130-87ab-fa06062bf05e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:03.610344 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-35276917-ba97-4130-87ab-fa06062bf05e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:03.739937 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-35276917-ba97-4130-87ab-fa06062bf05e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:03.743089 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-35276917-ba97-4130-87ab-fa06062bf05e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:03.748936 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-35276917-ba97-4130-87ab-fa06062bf05e admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/f33c327e-aa2e-478d-8dbf-05ee6e24f1cb HTTP/1.1" status: 204 len: 168 time: 0.2619903 Nov 11 17:29:03.769051 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35276917-ba97-4130-87ab-fa06062bf05e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f33c327e-aa2e-478d-8dbf-05ee6e24f1cb,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:03.815011 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-ab693f37-8c0a-4ede-8c72-6c0be5163187 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8103781', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-393853'] for router_interface, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:04.091207 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ab693f37-8c0a-4ede-8c72-6c0be5163187 admin admin] Router 0f921ab3-c03d-4722-9f80-7301a23dc466 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:29:04.236134 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ab693f37-8c0a-4ede-8c72-6c0be5163187 admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:29:04.241893 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-ab693f37-8c0a-4ede-8c72-6c0be5163187 admin admin] 10.222.0.16 "PUT /v2.0/routers/0f921ab3-c03d-4722-9f80-7301a23dc466/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0538559 Nov 11 17:29:04.244648 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38640) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:04.252188 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0db9d6da-82b6-42d2-9e88-d657cae82774 None None] Sync routers for ids ['0f921ab3-c03d-4722-9f80-7301a23dc466'] in dv-cinder-694140-2-iscsi {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:29:04.269766 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0db9d6da-82b6-42d2-9e88-d657cae82774 None None] Routers {'0f921ab3-c03d-4722-9f80-7301a23dc466'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:29:04.270433 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-0db9d6da-82b6-42d2-9e88-d657cae82774 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:29:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['0f921ab3-c03d-4722-9f80-7301a23dc466'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:04.382481 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5d035c80-7692-42a1-8bda-0758042ac679 admin admin] Publish callbacks [] for router, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:04.458379 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-0db9d6da-82b6-42d2-9e88-d657cae82774 None None] Set router 0f921ab3-c03d-4722-9f80-7301a23dc466 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:29:04.501223 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5d035c80-7692-42a1-8bda-0758042ac679 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:04.677327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-5d035c80-7692-42a1-8bda-0758042ac679 admin admin] Deleting port ec14a758-cddf-496c-98e0-e73ad442a6ad {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:29:04.677721 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5d035c80-7692-42a1-8bda-0758042ac679 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:04.736313 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:04.780573 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-0db9d6da-82b6-42d2-9e88-d657cae82774 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'name': 'tempest-TestMinimumBasicScenario-910390135-router', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:38Z', 'updated_at': '2021-11-11T17:29:03Z', 'revision_number': 5, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'gw_port': {'id': 'ec14a758-cddf-496c-98e0-e73ad442a6ad', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:7a:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:39Z', 'updated_at': '2021-11-11T17:26:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:04.802184 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-5d035c80-7692-42a1-8bda-0758042ac679 admin admin] For port ec14a758-cddf-496c-98e0-e73ad442a6ad, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=ec14a758-cddf-496c-98e0-e73ad442a6ad,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:29:04.802797 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5d035c80-7692-42a1-8bda-0758042ac679 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:04.816099 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0db9d6da-82b6-42d2-9e88-d657cae82774 None None] Checking router: 0f921ab3-c03d-4722-9f80-7301a23dc466 for host: dv-cinder-694140-2-iscsi {{(pid=102325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:29:04.820991 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-5d035c80-7692-42a1-8bda-0758042ac679 admin admin] Calling delete_port for ec14a758-cddf-496c-98e0-e73ad442a6ad owned by network:router_gateway {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:29:04.827344 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0db9d6da-82b6-42d2-9e88-d657cae82774 None None] Routers {'0f921ab3-c03d-4722-9f80-7301a23dc466'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:29:04.828121 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-0db9d6da-82b6-42d2-9e88-d657cae82774 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:29:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['0f921ab3-c03d-4722-9f80-7301a23dc466'], 'active': True} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:04.929664 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvr_db [None req-0db9d6da-82b6-42d2-9e88-d657cae82774 None None] Set router 0f921ab3-c03d-4722-9f80-7301a23dc466 gateway port host: None {{(pid=102325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:29:04.985857 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_hamode_db [None req-0db9d6da-82b6-42d2-9e88-d657cae82774 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'name': 'tempest-TestMinimumBasicScenario-910390135-router', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:38Z', 'updated_at': '2021-11-11T17:29:04Z', 'revision_number': 6, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'gw_port_host': None}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:05.017030 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0db9d6da-82b6-42d2-9e88-d657cae82774 None None] The sync data for ids ['0f921ab3-c03d-4722-9f80-7301a23dc466'] in dv-cinder-694140-2-iscsi is: [{'id': '0f921ab3-c03d-4722-9f80-7301a23dc466', 'name': 'tempest-TestMinimumBasicScenario-910390135-router', 'tenant_id': '0918d6b635a04c89ae9c7253d1a3901f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:38Z', 'updated_at': '2021-11-11T17:29:04Z', 'revision_number': 6, 'project_id': '0918d6b635a04c89ae9c7253d1a3901f', 'gw_port_host': None}] {{(pid=102325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:29:05.149424 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5d035c80-7692-42a1-8bda-0758042ac679 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:05.182411 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d035c80-7692-42a1-8bda-0758042ac679 admin admin] Pushing event deleted for resources: {'Port': ['ID=ec14a758-cddf-496c-98e0-e73ad442a6ad,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:05.250063 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5d035c80-7692-42a1-8bda-0758042ac679 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-397207'] for router_gateway, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:05.346796 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5d035c80-7692-42a1-8bda-0758042ac679 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-424448', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7353'] for router, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:05.349290 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5d035c80-7692-42a1-8bda-0758042ac679 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:05.475946 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5d035c80-7692-42a1-8bda-0758042ac679 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-424459'] for router, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:05.476591 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5d035c80-7692-42a1-8bda-0758042ac679 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0f921ab3-c03d-4722-9f80-7301a23dc466 {{(pid=102323) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 17:29:05.483753 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-5d035c80-7692-42a1-8bda-0758042ac679 admin admin] Publish callbacks [] for router, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:05.485876 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-5d035c80-7692-42a1-8bda-0758042ac679 admin admin] 10.222.0.16 "DELETE /v2.0/routers/0f921ab3-c03d-4722-9f80-7301a23dc466 HTTP/1.1" status: 204 len: 168 time: 1.2397814 Nov 11 17:29:05.489289 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38642) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:05.548736 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_v2 [None req-c1559283-8990-4050-b291-2e0d38e69961 admin admin] Deleting subnet 44d8c516-d4c3-4d4e-81bb-be7d2f3122ab {{(pid=102323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:29:05.552674 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c1559283-8990-4050-b291-2e0d38e69961 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:05.593012 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c1559283-8990-4050-b291-2e0d38e69961 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5777079'] for subnet, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:05.682070 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c1559283-8990-4050-b291-2e0d38e69961 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:05.831291 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c1559283-8990-4050-b291-2e0d38e69961 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5720643', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5388326'] for subnet, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:05.875327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1559283-8990-4050-b291-2e0d38e69961 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=44d8c516-d4c3-4d4e-81bb-be7d2f3122ab,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:05.885446 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c1559283-8990-4050-b291-2e0d38e69961 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:05.889146 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-c1559283-8990-4050-b291-2e0d38e69961 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/44d8c516-d4c3-4d4e-81bb-be7d2f3122ab HTTP/1.1" status: 204 len: 168 time: 0.3978214 Nov 11 17:29:05.895870 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38644) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:05.896744 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d9441f6-7863-4bbd-b788-59f3a69cc7d8 None None] Network 892c147f-3343-4b08-a9a7-9e968821be86 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:29:05.938071 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device ec14a758-cddf-496c-98e0-e73ad442a6ad no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:29:06.012955 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: ec14a758-cddf-496c-98e0-e73ad442a6ad {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:29:06.013490 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device ec14a758-cddf-496c-98e0-e73ad442a6ad not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:29:06.016254 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 47ad1537-84e2-4b23-9edf-269b2ea4d931 no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:29:06.016467 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:06.069943 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: 47ad1537-84e2-4b23-9edf-269b2ea4d931 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:29:06.073613 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 47ad1537-84e2-4b23-9edf-269b2ea4d931 not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:29:06.117408 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] Deleting port dc8d333c-43a3-4431-805f-02ea3c9f0efd {{(pid=102324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:29:06.119056 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:06.234135 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.db [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] For port dc8d333c-43a3-4431-805f-02ea3c9f0efd, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=dc8d333c-43a3-4431-805f-02ea3c9f0efd,segment=NetworkSegment(228b04b9-98b7-47bd-a901-1be44f34a0f9),segment_id=228b04b9-98b7-47bd-a901-1be44f34a0f9)] {{(pid=102324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:29:06.235511 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:06.238642 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b09866e0-e535-41ed-b166-d6deb7446b26 None None] DHCP port deletion for 892c147f-3343-4b08-a9a7-9e968821be86 request from dv-cinder-694140-2-iscsi {{(pid=102325) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 11 17:29:06.256164 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.plugin [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] Calling delete_port for dc8d333c-43a3-4431-805f-02ea3c9f0efd owned by network:dhcp {{(pid=102324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:29:06.335650 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-b09866e0-e535-41ed-b166-d6deb7446b26 None None] Deleting port dc8d333c-43a3-4431-805f-02ea3c9f0efd {{(pid=102325) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:29:06.336173 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b09866e0-e535-41ed-b166-d6deb7446b26 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:06.431786 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:06.436860 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5436189'] for port, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:06.465722 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-b09866e0-e535-41ed-b166-d6deb7446b26 None None] For port dc8d333c-43a3-4431-805f-02ea3c9f0efd, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=dc8d333c-43a3-4431-805f-02ea3c9f0efd,segment=NetworkSegment(228b04b9-98b7-47bd-a901-1be44f34a0f9),segment_id=228b04b9-98b7-47bd-a901-1be44f34a0f9)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:29:06.466317 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b09866e0-e535-41ed-b166-d6deb7446b26 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:06.476600 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] Pushing event deleted for resources: {'Port': ['ID=dc8d333c-43a3-4431-805f-02ea3c9f0efd,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:06.484146 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] No DVR routers for this DVR port dc8d333c-43a3-4431-805f-02ea3c9f0efd on host dv-cinder-694140-2-iscsi {{(pid=102324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:29:06.496347 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-b09866e0-e535-41ed-b166-d6deb7446b26 None None] Calling delete_port for dc8d333c-43a3-4431-805f-02ea3c9f0efd owned by network:dhcp {{(pid=102325) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:29:06.571065 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:06.604236 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['892c147f-3343-4b08-a9a7-9e968821be86']}} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:06.611032 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b09866e0-e535-41ed-b166-d6deb7446b26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633'] for port, after_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:06.622347 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '228b04b9-98b7-47bd-a901-1be44f34a0f9') {'for_net_delete': True} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:06.622919 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.services.segments.db [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '228b04b9-98b7-47bd-a901-1be44f34a0f9') {} {{(pid=102324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:06.641602 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5895812'] for segment, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:06.646456 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b09866e0-e535-41ed-b166-d6deb7446b26 None None] Pushing event deleted for resources: {'Port': ['ID=dc8d333c-43a3-4431-805f-02ea3c9f0efd,revision_number=None']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:06.652944 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b09866e0-e535-41ed-b166-d6deb7446b26 None None] No DVR routers for this DVR port dc8d333c-43a3-4431-805f-02ea3c9f0efd on host dv-cinder-694140-2-iscsi {{(pid=102325) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:29:06.659591 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:06.667100 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] Releasing vlan 534 on physical network physnet1 to pool {{(pid=102324) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:29:06.667497 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5436270'] for segment, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: Traceback (most recent call last): Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: timer() Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: cb(*args, **kw) Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: return func(*args, **kwargs) Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: self._notify() Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: self.callback(batched_events) Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: event.method(event) Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: return f(self, *a, **k) Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: return self._get(url).json() Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: return self.request(url, 'GET', **kwargs) Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:29:06.669515 dv-cinder-694140-2-iscsi neutron-server[102324]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:29:06.835653 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:06.842770 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:06.847212 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] 10.222.0.16 "DELETE /v2.0/networks/892c147f-3343-4b08-a9a7-9e968821be86 HTTP/1.1" status: 204 len: 168 time: 0.9473746 Nov 11 17:29:06.850446 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38646) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:06.859951 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f07f86d4-67b5-4767-8493-370427ec0fb2 admin admin] Pushing event deleted for resources: {'Network': ['ID=892c147f-3343-4b08-a9a7-9e968821be86,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:07.001567 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:07.299857 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-8f88ef66-10e3-4f81-b054-84e257684658 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-394221'] for router_interface, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:07.576046 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-8f88ef66-10e3-4f81-b054-84e257684658 admin admin] Deleting port efed5ca1-780e-4730-8e9a-766e764411d2 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:29:07.576438 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-8f88ef66-10e3-4f81-b054-84e257684658 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:07.768399 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device dc8d333c-43a3-4431-805f-02ea3c9f0efd no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:29:07.793205 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: dc8d333c-43a3-4431-805f-02ea3c9f0efd {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:29:07.793898 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device dc8d333c-43a3-4431-805f-02ea3c9f0efd not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:29:07.949391 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-8f88ef66-10e3-4f81-b054-84e257684658 admin admin] For port efed5ca1-780e-4730-8e9a-766e764411d2, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=efed5ca1-780e-4730-8e9a-766e764411d2,segment=NetworkSegment(e90a3aab-14f8-47af-bc48-1ed099ffa30c),segment_id=e90a3aab-14f8-47af-bc48-1ed099ffa30c)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:29:07.950938 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-8f88ef66-10e3-4f81-b054-84e257684658 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:07.965633 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-8f88ef66-10e3-4f81-b054-84e257684658 admin admin] Calling delete_port for efed5ca1-780e-4730-8e9a-766e764411d2 owned by network:router_interface {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:29:08.247655 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-8f88ef66-10e3-4f81-b054-84e257684658 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:08.274579 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f88ef66-10e3-4f81-b054-84e257684658 admin admin] Pushing event deleted for resources: {'Port': ['ID=efed5ca1-780e-4730-8e9a-766e764411d2,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:08.484699 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-8f88ef66-10e3-4f81-b054-84e257684658 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8103781', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-393853'] for router_interface, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:08.736128 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8f88ef66-10e3-4f81-b054-84e257684658 admin admin] Router 305cca58-7c3f-4b61-9307-6a6ecb3f20c2 has already been hosted by L3 agent 3aaa5d6f-3439-46f1-ad13-407fc8d848f9 {{(pid=102323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 17:29:08.893583 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8f88ef66-10e3-4f81-b054-84e257684658 admin admin] Notify agent at l3_agent.dv-cinder-694140-2-iscsi the message routers_updated {{(pid=102323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 17:29:08.899314 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-8f88ef66-10e3-4f81-b054-84e257684658 admin admin] 10.222.0.16 "PUT /v2.0/routers/305cca58-7c3f-4b61-9307-6a6ecb3f20c2/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0473251 Nov 11 17:29:08.904443 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38648) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:08.906004 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50fe36ee-ff90-4dee-bf0f-ed2f0c6c5123 None None] Sync routers for ids ['305cca58-7c3f-4b61-9307-6a6ecb3f20c2'] in dv-cinder-694140-2-iscsi {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 17:29:08.921946 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50fe36ee-ff90-4dee-bf0f-ed2f0c6c5123 None None] Routers {'305cca58-7c3f-4b61-9307-6a6ecb3f20c2'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:29:08.922973 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-50fe36ee-ff90-4dee-bf0f-ed2f0c6c5123 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:29:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['305cca58-7c3f-4b61-9307-6a6ecb3f20c2'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:09.058237 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-eb351af0-7e94-4f93-8878-96afc5aa763c admin admin] Publish callbacks [] for router, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:09.071639 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-50fe36ee-ff90-4dee-bf0f-ed2f0c6c5123 None None] Set router 305cca58-7c3f-4b61-9307-6a6ecb3f20c2 gateway port host: dv-cinder-694140-2-iscsi {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:29:09.207748 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-eb351af0-7e94-4f93-8878-96afc5aa763c admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:09.321836 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-50fe36ee-ff90-4dee-bf0f-ed2f0c6c5123 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'name': 'tempest-TestMinimumBasicScenario-1633009201-router', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'external_fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.168'}], 'enable_snat': True}, 'gw_port_id': 'a2a0a8b9-252d-46a7-bbe4-6cda0eb86104', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:46Z', 'updated_at': '2021-11-11T17:29:08Z', 'revision_number': 5, 'project_id': '3130da64ca90454cbfe95cf315e224fb', 'gw_port': {'id': 'a2a0a8b9-252d-46a7-bbe4-6cda0eb86104', 'name': '', 'network_id': '78b17769-6fae-453e-8ae3-4a72e72bccfc', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:bb:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '85627140-b558-482a-a384-b2095063cd88', 'ip_address': '172.27.1.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-694140-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T17:26:47Z', 'updated_at': '2021-11-11T17:26:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '85627140-b558-482a-a384-b2095063cd88', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-694140-2-iscsi'}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:09.333897 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-eb351af0-7e94-4f93-8878-96afc5aa763c admin admin] Deleting port a2a0a8b9-252d-46a7-bbe4-6cda0eb86104 {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:29:09.334262 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-eb351af0-7e94-4f93-8878-96afc5aa763c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:09.352158 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50fe36ee-ff90-4dee-bf0f-ed2f0c6c5123 None None] Checking router: 305cca58-7c3f-4b61-9307-6a6ecb3f20c2 for host: dv-cinder-694140-2-iscsi {{(pid=102326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 17:29:09.362891 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50fe36ee-ff90-4dee-bf0f-ed2f0c6c5123 None None] Routers {'305cca58-7c3f-4b61-9307-6a6ecb3f20c2'} bound to L3 agent in host dv-cinder-694140-2-iscsi {{(pid=102326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 17:29:09.363519 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-50fe36ee-ff90-4dee-bf0f-ed2f0c6c5123 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-694140-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-11T17:05:33Z,description=,heartbeat_timestamp=2021-11-11T17:29:03Z,host='dv-cinder-694140-2-iscsi',id=3aaa5d6f-3439-46f1-ad13-407fc8d848f9,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T17:05:34Z,topic='l3_agent')) {'router_ids': ['305cca58-7c3f-4b61-9307-6a6ecb3f20c2'], 'active': True} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:09.448900 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-eb351af0-7e94-4f93-8878-96afc5aa763c admin admin] For port a2a0a8b9-252d-46a7-bbe4-6cda0eb86104, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=a2a0a8b9-252d-46a7-bbe4-6cda0eb86104,segment=NetworkSegment(7424c811-7de6-42e6-8320-5f665532ffaf),segment_id=7424c811-7de6-42e6-8320-5f665532ffaf)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:29:09.449370 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-eb351af0-7e94-4f93-8878-96afc5aa763c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:09.467201 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-eb351af0-7e94-4f93-8878-96afc5aa763c admin admin] Calling delete_port for a2a0a8b9-252d-46a7-bbe4-6cda0eb86104 owned by network:router_gateway {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:29:09.485611 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_dvr_db [None req-50fe36ee-ff90-4dee-bf0f-ed2f0c6c5123 None None] Set router 305cca58-7c3f-4b61-9307-6a6ecb3f20c2 gateway port host: None {{(pid=102326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 17:29:09.568909 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.l3_hamode_db [None req-50fe36ee-ff90-4dee-bf0f-ed2f0c6c5123 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'name': 'tempest-TestMinimumBasicScenario-1633009201-router', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:46Z', 'updated_at': '2021-11-11T17:29:09Z', 'revision_number': 6, 'project_id': '3130da64ca90454cbfe95cf315e224fb', 'gw_port_host': None}], 'dv-cinder-694140-2-iscsi', False) {} {{(pid=102326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:09.600518 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50fe36ee-ff90-4dee-bf0f-ed2f0c6c5123 None None] The sync data for ids ['305cca58-7c3f-4b61-9307-6a6ecb3f20c2'] in dv-cinder-694140-2-iscsi is: [{'id': '305cca58-7c3f-4b61-9307-6a6ecb3f20c2', 'name': 'tempest-TestMinimumBasicScenario-1633009201-router', 'tenant_id': '3130da64ca90454cbfe95cf315e224fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T17:26:46Z', 'updated_at': '2021-11-11T17:29:09Z', 'revision_number': 6, 'project_id': '3130da64ca90454cbfe95cf315e224fb', 'gw_port_host': None}] {{(pid=102326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 17:29:09.772969 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-eb351af0-7e94-4f93-8878-96afc5aa763c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:09.801270 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb351af0-7e94-4f93-8878-96afc5aa763c admin admin] Pushing event deleted for resources: {'Port': ['ID=a2a0a8b9-252d-46a7-bbe4-6cda0eb86104,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:09.882776 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-eb351af0-7e94-4f93-8878-96afc5aa763c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-397207'] for router_gateway, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:10.001612 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-eb351af0-7e94-4f93-8878-96afc5aa763c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-424448', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7353'] for router, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:10.005119 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-eb351af0-7e94-4f93-8878-96afc5aa763c admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:10.121715 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-eb351af0-7e94-4f93-8878-96afc5aa763c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-424459'] for router, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:10.123401 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eb351af0-7e94-4f93-8878-96afc5aa763c admin admin] Fanout notify agent at l3_agent the message router_deleted on router 305cca58-7c3f-4b61-9307-6a6ecb3f20c2 {{(pid=102323) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 17:29:10.127877 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-eb351af0-7e94-4f93-8878-96afc5aa763c admin admin] Publish callbacks [] for router, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:10.129164 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-eb351af0-7e94-4f93-8878-96afc5aa763c admin admin] 10.222.0.16 "DELETE /v2.0/routers/305cca58-7c3f-4b61-9307-6a6ecb3f20c2 HTTP/1.1" status: 204 len: 168 time: 1.2232521 Nov 11 17:29:10.132440 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38650) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:10.183608 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.db_base_plugin_v2 [None req-85a2deb9-596d-4d1e-a26e-85569f1e06b7 admin admin] Deleting subnet 2d507788-8511-49e5-8d1c-7289c3ccf113 {{(pid=102323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 17:29:10.187954 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-85a2deb9-596d-4d1e-a26e-85569f1e06b7 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:10.231702 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-85a2deb9-596d-4d1e-a26e-85569f1e06b7 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5777079'] for subnet, precommit_delete_associations {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:10.320669 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-85a2deb9-596d-4d1e-a26e-85569f1e06b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-708106'] for subnet, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:10.434092 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device efed5ca1-780e-4730-8e9a-766e764411d2 no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:29:10.470922 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: efed5ca1-780e-4730-8e9a-766e764411d2 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:29:10.471421 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device efed5ca1-780e-4730-8e9a-766e764411d2 not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:29:10.521827 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-85a2deb9-596d-4d1e-a26e-85569f1e06b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-708099', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8103198', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5720643', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5388326'] for subnet, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:10.552561 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85a2deb9-596d-4d1e-a26e-85569f1e06b7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2d507788-8511-49e5-8d1c-7289c3ccf113,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:10.556782 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-85a2deb9-596d-4d1e-a26e-85569f1e06b7 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:10.561585 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-85a2deb9-596d-4d1e-a26e-85569f1e06b7 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/2d507788-8511-49e5-8d1c-7289c3ccf113 HTTP/1.1" status: 204 len: 168 time: 0.4272869 Nov 11 17:29:10.564105 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38652) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:10.568159 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36e4a959-bb2a-4b08-9a03-6e081c4bf4d5 None None] Network 85f429c8-7dd6-424d-bd82-58d9de8bbd92 requested from dv-cinder-694140-2-iscsi {{(pid=102325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 17:29:10.649810 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-694886'] for network, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:10.726454 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] Deleting port 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b {{(pid=102323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:29:10.727016 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:10.830729 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.db [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] For port 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b,segment=NetworkSegment(e90a3aab-14f8-47af-bc48-1ed099ffa30c),segment_id=e90a3aab-14f8-47af-bc48-1ed099ffa30c)] {{(pid=102323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:29:10.831124 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:10.850327 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.plugin [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] Calling delete_port for 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b owned by network:dhcp {{(pid=102323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:29:10.859229 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-386503db-21c8-4a8e-afb3-ddf82c594d31 None None] DHCP port deletion for 85f429c8-7dd6-424d-bd82-58d9de8bbd92 request from dv-cinder-694140-2-iscsi {{(pid=102325) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 11 17:29:10.954537 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-386503db-21c8-4a8e-afb3-ddf82c594d31 None None] Deleting port 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b {{(pid=102325) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 17:29:10.955145 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-386503db-21c8-4a8e-afb3-ddf82c594d31 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8735338502319'] for port, before_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:11.026614 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.db [None req-386503db-21c8-4a8e-afb3-ddf82c594d31 None None] For port 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b, host dv-cinder-694140-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-694140-2-iscsi',level=0,port_id=3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b,segment=NetworkSegment(e90a3aab-14f8-47af-bc48-1ed099ffa30c),segment_id=e90a3aab-14f8-47af-bc48-1ed099ffa30c)] {{(pid=102325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 17:29:11.026980 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-386503db-21c8-4a8e-afb3-ddf82c594d31 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-400651'] for port, precommit_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:11.036168 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5720686'] for port, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:11.047809 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-386503db-21c8-4a8e-afb3-ddf82c594d31 None None] Calling delete_port for 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b owned by network:dhcp {{(pid=102325) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 17:29:11.079746 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] Pushing event deleted for resources: {'Port': ['ID=3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:11.085629 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] No DVR routers for this DVR port 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b on host dv-cinder-694140-2-iscsi {{(pid=102323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:29:11.184975 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-386503db-21c8-4a8e-afb3-ddf82c594d31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7714763', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8344223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8735338510201', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8735338080633'] for port, after_delete {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:11.209706 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-707251', 'neutron.services.segments.db._delete_segments_for_network-8735338596325'] for network, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:11.224142 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-386503db-21c8-4a8e-afb3-ddf82c594d31 None None] No DVR routers for this DVR port 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b on host dv-cinder-694140-2-iscsi {{(pid=102325) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 17:29:11.226874 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-386503db-21c8-4a8e-afb3-ddf82c594d31 None None] Pushing event deleted for resources: {'Port': ['ID=3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b,revision_number=None']} {{(pid=102325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:11.243564 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['85f429c8-7dd6-424d-bd82-58d9de8bbd92']}} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:11.260533 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e90a3aab-14f8-47af-bc48-1ed099ffa30c') {'for_net_delete': True} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:11.260812 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.services.segments.db [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e90a3aab-14f8-47af-bc48-1ed099ffa30c') {} {{(pid=102323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 17:29:11.280559 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8735338617838', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5777070'] for segment, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:11.296629 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347'] for segment, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:11.304140 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] Releasing vlan 543 on physical network physnet1 to pool {{(pid=102323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-710347', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5720605'] for segment, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: Traceback (most recent call last): Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: timer() Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: cb(*args, **kw) Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: return func(*args, **kwargs) Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: self._notify() Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: self.callback(batched_events) Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: event.method(event) Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: return f(self, *a, **k) Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._get(url).json() Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: return self.request(url, 'GET', **kwargs) Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 17:29:11.307879 dv-cinder-694140-2-iscsi neutron-server[102323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 17:29:11.441885 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-707204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7867755', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8103838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-397307'] for network, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:11.447747 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8103816'] for network, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:11.451925 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] 10.222.0.16 "DELETE /v2.0/networks/85f429c8-7dd6-424d-bd82-58d9de8bbd92 HTTP/1.1" status: 204 len: 168 time: 0.8866353 Nov 11 17:29:11.463940 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15e2916d-c609-4dd6-8892-4e58fdc116a9 admin admin] Pushing event deleted for resources: {'Network': ['ID=85f429c8-7dd6-424d-bd82-58d9de8bbd92,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:11.764118 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:29:11.787154 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:29:11.787497 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device 3b26d7c0-c99e-4c1f-976a-dfbbbcd9900b not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:29:11.788730 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device a2a0a8b9-252d-46a7-bbe4-6cda0eb86104 no longer exists at agent ovs-agent-dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 17:29:11.808359 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.plugin [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] No Port match for: a2a0a8b9-252d-46a7-bbe4-6cda0eb86104 {{(pid=102325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 17:29:11.808698 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron.plugins.ml2.rpc [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Device a2a0a8b9-252d-46a7-bbe4-6cda0eb86104 not bound to the agent host dv-cinder-694140-2-iscsi {{(pid=102325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 17:29:11.855009 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38656) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:11.901465 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-dcea66b3-47f7-4e1f-b084-3f629d69e7fc admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=0918d6b635a04c89ae9c7253d1a3901f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0449142 Nov 11 17:29:11.904534 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [-] (102323) accepted ('10.222.0.16', 38658) {{(pid=102323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:11.961338 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c003ba21-5aa8-4380-a043-b8d603fc44ec admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:11.987569 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c003ba21-5aa8-4380-a043-b8d603fc44ec admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:12.121747 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c003ba21-5aa8-4380-a043-b8d603fc44ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:12.125465 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron_lib.callbacks.manager [None req-c003ba21-5aa8-4380-a043-b8d603fc44ec admin admin] Publish callbacks [] for security_group, before_response {{(pid=102323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:12.127051 dv-cinder-694140-2-iscsi neutron-server[102323]: INFO neutron.wsgi [None req-c003ba21-5aa8-4380-a043-b8d603fc44ec admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/a6f2f987-e7b7-4ed2-ae1e-736f35635781 HTTP/1.1" status: 204 len: 168 time: 0.2211738 Nov 11 17:29:12.137663 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c003ba21-5aa8-4380-a043-b8d603fc44ec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6f2f987-e7b7-4ed2-ae1e-736f35635781,revision_number=None']} {{(pid=102323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:13.039167 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38664) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:13.100687 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-61e17d36-50da-4f21-a50d-4cf94923c0cc admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=3130da64ca90454cbfe95cf315e224fb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0597019 Nov 11 17:29:13.103291 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.wsgi [-] (102324) accepted ('10.222.0.16', 38666) {{(pid=102324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 17:29:13.192416 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-49f4fc1c-ce6f-456c-b4c3-cbe19c54587d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:13.233316 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-49f4fc1c-ce6f-456c-b4c3-cbe19c54587d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:13.396137 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-49f4fc1c-ce6f-456c-b4c3-cbe19c54587d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7865815'] for security_group, after_delete {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:13.398918 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron_lib.callbacks.manager [None req-49f4fc1c-ce6f-456c-b4c3-cbe19c54587d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:13.400287 dv-cinder-694140-2-iscsi neutron-server[102324]: INFO neutron.wsgi [None req-49f4fc1c-ce6f-456c-b4c3-cbe19c54587d admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/011addfb-1e67-49e1-92cc-581350960f47 HTTP/1.1" status: 204 len: 168 time: 0.2956078 Nov 11 17:29:13.408808 dv-cinder-694140-2-iscsi neutron-server[102324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49f4fc1c-ce6f-456c-b4c3-cbe19c54587d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=011addfb-1e67-49e1-92cc-581350960f47,revision_number=None']} {{(pid=102324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 17:29:16.992157 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:27.211727 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:29:30.969750 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-60e38477-20e5-41c2-be36-f64f5c38d699 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:33.512562 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3168155d-6972-416b-84ba-71e00d734232 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:34.673603 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:36.552915 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:37.016129 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:29:42.863416 dv-cinder-694140-2-iscsi neutron-server[102323]: DEBUG neutron.wsgi [req-fd819bbd-86e0-4f2f-86b1-5f2a84d9c061 req-d1442147-bf93-45d0-a8d2-8deb1b49c1ed service neutron] (102323) timed out ('10.222.0.10', 50539) {{(pid=102323) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 11 17:29:46.999272 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:30:00.972571 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-e62ec9e8-4ede-414c-a079-e54b2d0998d8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:30:03.527234 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-2ee9ab14-e8d6-4128-a330-46ee47f101c5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:30:04.213261 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:30:04.647392 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:30:06.407677 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:30:07.012401 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:30:16.996054 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:30:30.957084 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-5fba9242-e801-4386-947f-056f8c92055b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:30:33.511622 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-7ef95eee-b25b-4478-8f80-758702de4136 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:30:34.734779 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:30:36.397712 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:30:36.997422 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:30:41.215656 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:30:47.089717 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:31:00.930750 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-1e611b65-5503-44d8-bde1-e2d405bf7dec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:31:03.513750 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-418dd93f-0887-4f83-8f56-4d9a38a29d6c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:31:04.719295 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:31:06.388281 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:31:06.994043 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:31:17.040507 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:31:18.215969 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:31:30.955230 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-b5d8e3d3-92de-4d39-9669-283652cbc1f2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:31:33.526802 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-c165da49-9bb3-4777-9f76-da6cd9f3b680 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:31:34.663780 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:31:36.423866 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:31:37.029509 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:31:47.064663 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:31:55.217766 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:32:00.984617 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fe80609d-4304-4bb1-9cca-9db719f24e6a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:32:03.516165 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-9d3874b8-c1e3-4080-ac92-ac310c384f2a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:32:04.670457 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:32:06.402355 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:32:07.002401 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:32:17.070997 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:32:30.951244 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-0b0afc34-4ee4-46a0-8fd7-c3a1c04b6883 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:32:32.218394 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:32:33.500471 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-21c73bdb-0262-499e-9925-a70eecd19b9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:32:34.659750 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:32:36.414897 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:32:37.026682 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:32:47.077717 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:33:00.969553 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-aa9eeef7-87c6-4d50-a465-d4db8e405130 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:33:03.518049 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-5fde0ec9-8665-43ce-aa2c-ee96aec4e50e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:33:04.678053 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:33:06.415331 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:33:07.037867 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:33:09.219665 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:33:17.060969 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:33:30.935636 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fef1775f-512b-430a-9481-b9e720affe94 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:33:33.524062 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ad6e6b91-94fb-4579-bc07-d4ffb718f04c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:33:34.735366 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:33:36.439569 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:33:37.027358 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:33:46.219991 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 17:33:47.095241 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:34:00.923940 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-ccb457d7-e6d3-4c15-9c73-18270312b890 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:34:03.506484 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-cd1bd034-a071-457a-976c-6ef1ae18da82 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:34:04.649548 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-bb768fcc-d560-4731-a1c0-2a4d209d81bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:34:06.489796 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-3fb96ead-c5d8-430e-9462-f636c15cc5e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:34:07.038418 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-fd9ecbb2-0e15-4d08-b057-cef06ec3f8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:34:17.135997 dv-cinder-694140-2-iscsi neutron-server[102325]: DEBUG neutron_lib.callbacks.manager [None req-4b5d5ca8-4ef1-4216-851b-b1238a2e6507 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8735338596307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-705353'] for agent, after_update {{(pid=102325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 17:34:23.220330 dv-cinder-694140-2-iscsi neutron-server[102326]: DEBUG neutron.db.agents_db [None req-a0bd42d6-75c7-4f70-b517-f0dc56c97696 None None] Agent healthcheck: found 6 active agents {{(pid=102326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}